-- Logs begin at Tue 2022-10-04 11:07:20 UTC, end at Tue 2022-10-04 12:25:19 UTC. -- Oct 04 11:52:45.687525 dv-cinder-860212-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 11:52:45.702131 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 11:52:45 2022] *** Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: nodename: dv-cinder-860212-2-iscsi Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: machine: x86_64 Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: clock source: unix Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: pcre jit disabled Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: detected number of CPU cores: 4 Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: current working directory: / Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: detected binary path: /usr/bin/uwsgi-core Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: your processes number limit is 47680 Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: your memory page size is 4096 bytes Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: detected max file descriptor number: 2048 Oct 04 11:52:45.704502 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: lock engine: pthread robust mutexes Oct 04 11:52:45.706085 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: thunder lock: enabled Oct 04 11:52:45.706085 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 11:52:45.706085 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 11:52:45.746035 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: Python main interpreter initialized at 0x55ee7b7259c0 Oct 04 11:52:45.746035 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: python threads support enabled Oct 04 11:52:45.746035 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: your server socket listen backlog is limited to 100 connections Oct 04 11:52:45.746035 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: your mercy for graceful operations on workers is 90 seconds Oct 04 11:52:45.746697 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 11:52:45.746697 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: *** Operational MODE: preforking *** Oct 04 11:52:45.746902 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: *** uWSGI is running in multiple interpreter mode *** Oct 04 11:52:45.746902 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: spawned uWSGI master process (pid: 117572) Oct 04 11:52:45.747111 dv-cinder-860212-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 11:52:45.747963 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: spawned uWSGI worker 1 (pid: 117573, cores: 1) Oct 04 11:52:45.748325 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: spawned uWSGI worker 2 (pid: 117574, cores: 1) Oct 04 11:52:45.748504 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 11:52:46.492836 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 11:52:46.496465 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 11:52:47.631507 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:52:47.631507 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: from cryptography.utils import int_from_bytes Oct 04 11:52:47.632633 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:52:47.632633 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: from cryptography.utils import int_from_bytes Oct 04 11:52:47.659443 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:52:47.659443 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: from cryptography.utils import int_from_bytes Oct 04 11:52:47.660467 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 11:52:47.660467 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: from cryptography.utils import int_from_bytes Oct 04 11:52:50.369401 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 11:52:50.370451 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 11:52:50.371071 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 11:52:50.371220 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 11:52:50.371365 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 11:52:50.371517 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 11:52:50.371665 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 11:52:50.371812 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 11:52:50.371987 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 11:52:50.372156 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 11:52:50.372336 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.372485 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.372647 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.373056 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.373200 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.373343 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.373485 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.373629 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.373789 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.374097 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.374273 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.374443 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.374593 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.374752 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.374893 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.375050 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.375227 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.375895 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.376065 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.376279 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.376419 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.376582 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.376743 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-2-iscsi {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.376904 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-2-iscsi {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.377066 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.377236 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.377393 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.377393 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.377699 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.377854 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.378013 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.378239 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.378239 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.378615 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.378976 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.379190 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.379397 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.379397 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.379798 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.380004 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.380340 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.380564 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.380564 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.380564 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.381119 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.381295 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.381295 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.381630 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.381794 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.381794 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.382197 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.382398 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.382571 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.382729 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-2-iscsi {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.382729 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.383007 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.383162 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.383162 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.383581 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.383805 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.383958 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.384225 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.384225 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.384609 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.384767 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.384767 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.385133 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.385361 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.385361 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.386100 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.386268 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.386268 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.386582 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.386740 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.386740 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.387020 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-2-iscsi {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.387178 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.387178 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.387476 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.387629 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.387629 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.387916 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.388110 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.388110 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.388480 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.388641 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.388641 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.388641 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.389197 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.389419 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.389419 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.389776 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.389925 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.389925 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.390211 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.390392 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.390549 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.390750 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.390750 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.391057 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.391203 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.391203 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.391480 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.391635 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.391807 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.392011 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.392220 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.392428 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.392616 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.392766 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.393115 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.393272 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.393469 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.393681 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.393836 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.394090 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.394266 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.394503 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.394729 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.394893 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.395049 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.395279 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.395450 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.395694 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.395853 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.396108 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.396390 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.396568 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.396726 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.396932 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.397095 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.397311 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.397473 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.397639 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.397881 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.398037 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.398250 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.398447 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.398610 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.398816 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.399003 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.399160 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.399377 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.399601 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.399773 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.399990 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.400141 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.400358 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.400504 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.400668 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.400906 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.401129 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.401294 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.401507 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.401658 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.401822 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.402064 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.402218 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.402375 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.402604 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.402769 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.402977 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.403150 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.403302 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.403623 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.403787 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.404016 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.404317 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.404515 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.404666 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.404822 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.404980 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.405133 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.405337 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.405517 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.405713 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.405903 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.406054 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.406335 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.406509 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.406656 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.406911 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.407068 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.407247 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.407473 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.407648 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.407858 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.408007 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.408154 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.408492 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.408643 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.408845 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.409103 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.409254 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.409414 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.409664 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.409833 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.410007 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.410217 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.410381 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.410604 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.410833 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.411005 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.411219 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.411374 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.411585 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.411826 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.411987 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.412148 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.412450 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.412601 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.412787 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.413044 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.413199 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.413366 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.413599 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.413765 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.413959 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.414157 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.414323 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.414607 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.414745 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.414944 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.415162 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.415315 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.415590 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.415742 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.415923 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.416270 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.416428 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.416633 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.416899 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.417056 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.417206 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.417349 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.417508 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.417729 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.417891 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.418097 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.418292 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.418439 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.418752 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.418920 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.419069 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.419856 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.420013 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.420195 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.420422 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.420604 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.420825 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.420973 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.421119 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.421459 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.421669 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.421836 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.422014 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.422251 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.422516 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.422671 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.422902 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.423072 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.423232 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.423554 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.423780 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.424009 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.424289 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.424519 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.424519 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.424980 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.425208 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.425208 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.425650 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.425864 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.425864 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.426293 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.426444 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.426656 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.426957 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.426957 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.427438 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.427744 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.427744 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.428216 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.428549 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.428754 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.429030 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.429030 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.429434 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.429662 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.429899 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.430126 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.430126 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.430550 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.430771 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.430771 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.431207 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.431419 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.431419 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.431855 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.432067 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.432067 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.432525 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.432789 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.432789 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.433318 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.433532 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.433756 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.433981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.433981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.434268 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.434415 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.434415 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.434698 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.435488 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.435488 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.435822 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.435983 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.435983 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.436308 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.436457 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.436605 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.436815 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.436815 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.437182 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.437389 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.437389 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.437681 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.437848 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.437848 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.438178 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.438342 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.438342 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.438624 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.438773 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.438773 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.439057 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.439221 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.439377 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.439563 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.439563 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.439909 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.440070 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.440070 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.440393 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.440541 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.440687 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.440830 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.440996 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.441236 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.441393 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.441579 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.441793 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.441955 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.442243 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.442433 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.442613 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.442839 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.443026 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.443205 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.443412 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.443561 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.443769 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.443927 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.444075 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.444379 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.444524 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.444672 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.444981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.445135 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.445282 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.445551 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 11:52:50.445801 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.445951 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.446129 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.446283 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.446439 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.446714 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.446871 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.447180 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.447335 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.447483 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.447644 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.447850 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.448019 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.448272 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.448463 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.448619 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.448917 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.449069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.449263 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.449515 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.449670 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.449918 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.450083 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.450230 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.450588 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.450746 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.450983 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.451146 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.451309 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.451601 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.451844 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.452083 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.452284 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.452448 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.452596 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.452752 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.452900 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.453160 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.453331 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.453496 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.453769 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.453925 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.454070 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.454324 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.454490 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.454694 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.454883 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.455035 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.455345 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.455499 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.455689 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.455921 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.456137 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.456425 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.456573 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.456719 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.456955 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.457236 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.457446 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.457600 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.457824 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.457975 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.458184 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.458350 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.458552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.458712 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.458860 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.459175 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.459338 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.459496 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.459785 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.459954 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.460103 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.460356 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.460532 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.460726 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.460940 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.461104 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.461369 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.461537 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.461775 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.462033 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.462253 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.462402 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.462590 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.462767 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.463024 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.463175 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.463320 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.463636 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.463790 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.463952 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.464207 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.464394 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.464544 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.464767 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.464925 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.465173 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.465322 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.465469 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.465786 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.465954 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.466138 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.466397 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.466575 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.466742 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.466891 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.467038 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.467322 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.467493 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.467711 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.467928 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.468226 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.468446 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.468682 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.468836 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.469070 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.469282 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.469496 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.469722 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.469948 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.470163 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.470163 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.470566 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.470794 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.470794 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.471230 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.471444 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.471674 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.471904 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.471904 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.472395 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.472618 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.472618 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.473025 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.473238 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.473238 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.473649 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.473876 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.473876 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.474378 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.474615 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.474615 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.475047 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.475303 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.475303 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.475706 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.475919 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.475919 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.476383 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.476594 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.476594 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.476876 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.477026 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.477026 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.477308 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.477475 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.477475 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.477839 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.478001 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.478001 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.478298 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.478443 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.478591 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.478751 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.478896 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.479058 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.479274 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.479484 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.479663 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.479928 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.480316 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.480486 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.480654 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.480813 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.480960 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.481102 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.481249 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.481506 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.481671 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.482333 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.482633 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.482800 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.482946 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.483196 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.483372 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.483530 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.483752 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.483918 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.484124 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.484382 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.484580 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.484741 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.484883 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.485183 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.485419 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.485583 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.485806 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.485967 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.486114 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.486409 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.486566 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.486716 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.486948 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.487105 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.487333 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.487491 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.487651 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.487931 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.488086 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.488261 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.488560 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.488735 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.488900 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.489113 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.489287 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.489535 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.489758 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.489926 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.490175 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.490337 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.490494 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.490796 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.490951 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.491100 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.491339 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.491496 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.491684 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.491897 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.492057 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.492368 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.492536 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.492736 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.492995 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.493148 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.493308 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.493565 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.493734 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.493882 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.494126 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.494282 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.494482 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.494697 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.494851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.495093 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.495245 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.495391 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.495695 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.495870 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.496065 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.496312 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.496490 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.496702 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.496863 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.497029 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.497317 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.498264 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.498426 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.498695 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.498887 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.499038 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.499190 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.499334 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.499611 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.499755 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.499902 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.500090 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.500263 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.500532 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.500677 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.500864 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.501028 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.501160 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.501459 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.501607 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.501744 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.501964 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.502118 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.502348 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.502494 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.502633 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.502878 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.503123 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.503283 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.503434 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.503587 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.503857 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.504030 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.504231 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.504484 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.504645 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.504797 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.505029 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.505187 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.505357 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.505630 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.505857 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.506090 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.506305 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.506522 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.506522 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.506951 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.507176 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.507176 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.507470 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.507636 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.507785 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.507929 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.508076 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.508341 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.508491 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.508690 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.508999 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.509222 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.509452 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.509666 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.509886 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.510115 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.510331 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.510547 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.510547 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.511006 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.511301 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.511301 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.511730 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.511941 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.512153 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.512404 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.512404 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.512828 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.513213 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.513213 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.513617 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.513850 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.513850 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.514278 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.514493 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.514493 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.514922 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.515139 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.515139 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.515597 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.515812 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.515964 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.516233 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.516233 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.516691 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.516917 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.516917 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.517354 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.517571 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.517571 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.518089 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.518308 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.518308 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.518724 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.518970 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.518970 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.519409 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.519650 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.519650 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.520067 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.520329 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.520329 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.520751 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.520975 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.520975 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.521395 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.521610 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.521839 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.522052 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.522296 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.522515 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.522739 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.523013 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.523013 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.523384 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.523518 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.523518 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.524004 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.524264 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.524264 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.524673 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.524899 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.524899 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.525330 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.525558 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.525558 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.525927 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.526142 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.526359 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.526572 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.526572 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.526991 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.527199 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.527199 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.527549 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.528014 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.528014 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.529165 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.529403 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.529403 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.529833 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.530060 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.530060 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.530498 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.530708 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.530936 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.531149 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.531403 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.531619 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.531619 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.532042 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.532284 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.532284 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.532707 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.532922 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.532922 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.533243 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.533510 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.533768 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.533942 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.533942 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.534366 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.534577 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.534577 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.534995 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.535157 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.535428 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.535649 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.535649 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.535984 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.536271 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.536271 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.536708 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.536951 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.536951 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.537353 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.537521 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.537521 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.537760 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.538304 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.538304 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.538721 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.538946 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.539173 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.539406 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.539406 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.539850 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.540077 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.540317 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.540531 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.540531 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.540948 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.541170 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.541170 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.541640 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.541849 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.541849 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.542247 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.542482 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.542482 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.542903 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.543140 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.543140 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.543484 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.543638 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.543638 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.543919 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.544126 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.544958 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545107 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545107 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545398 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545546 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545546 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545838 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545986 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.545986 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.546346 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.546493 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.546493 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.546761 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.546909 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.546909 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.547193 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.547338 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.547338 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.547606 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.547831 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.547831 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.548225 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.548377 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.548508 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.548656 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.548656 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.548948 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.549092 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.549092 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.549361 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.549506 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.549506 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.549896 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.550061 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.550219 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.550375 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.550375 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.550666 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.550822 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.550822 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.551096 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.551241 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.551241 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.551525 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.551669 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.551669 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.551935 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.552080 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.552080 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.552393 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.552540 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.552687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.552845 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.552845 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.553125 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.553286 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.553434 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.553587 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.553734 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.553966 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.554194 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.554343 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.554572 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.554722 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.554868 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.555119 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.555458 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.555608 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.555766 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.555897 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.556116 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.556365 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.556516 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.556753 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.556909 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.557056 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.557288 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.557466 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.557684 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.557891 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.558050 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.558304 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.558622 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.558790 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.558938 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.559226 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.559394 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.559543 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.559772 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.560038 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.560248 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.560395 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.560768 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.560942 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.561114 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.561399 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.561567 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.561726 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.561973 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.562128 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.562312 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.562557 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.562712 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.562927 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.563103 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.563256 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.563536 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.563701 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.563865 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.564121 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.564405 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.564556 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.564698 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.564868 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.565145 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.565296 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.565467 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.565785 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.565954 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.566103 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.566319 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.566475 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.566753 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.566912 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.567073 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.567356 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.567515 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.567704 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.567909 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.568063 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.568362 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.568501 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.568669 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.568953 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.569110 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.569282 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.569493 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.569660 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.569884 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.570100 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.570298 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.570501 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.570651 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.570802 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.571080 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.571236 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.571464 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.571633 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.571782 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.572086 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.572363 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.572511 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.572683 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.572859 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.573214 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.573372 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.573602 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.573753 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.573930 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.574219 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.574379 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.574562 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.574807 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.575027 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.575409 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.575676 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.575912 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.575912 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.576384 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.576535 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.576535 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.576807 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.576981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.577128 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.577272 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.577420 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.577670 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.577822 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.577985 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.578234 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.578451 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.578595 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.578909 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.579155 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.579373 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.579543 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.579820 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.579974 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.580242 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.580460 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.580615 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.580803 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.580950 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.581098 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.581420 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.581592 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.581742 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.581965 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.582136 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.582326 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.582491 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.582651 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.582936 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.583100 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.583251 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.583541 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.583784 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.584082 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.584331 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.584547 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.584547 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.585013 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.585240 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.585240 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.585651 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.585871 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.585871 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.586271 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.586532 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.586532 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.586950 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.587165 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.587165 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.587573 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.587867 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.587867 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.588312 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.588530 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.588681 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.588892 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.588892 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.589332 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.589548 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.589548 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.589963 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.590229 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.590229 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.590682 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.590897 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.590897 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.591837 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.592062 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.592062 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.592556 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.592777 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.592991 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.593204 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.593204 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.593628 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.593844 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.593844 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.594259 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.594494 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.594494 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.594947 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.594947 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.595369 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.595369 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.595843 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.596057 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.596057 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.596489 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.596702 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.596935 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.597163 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.597163 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.597566 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.597792 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.597792 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.598219 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.598446 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.598446 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.598849 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.599100 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.599100 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.599472 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.599620 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.599620 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.599888 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.600046 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.600046 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.600426 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.600559 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.600768 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.600976 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.600976 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.601252 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.601410 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.601410 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.601737 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.601884 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.601884 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.602152 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.602321 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.602321 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.602601 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.602771 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.602930 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.603192 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.603192 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.603488 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.603636 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.603636 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.603920 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.604078 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.604078 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.604395 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.604542 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.604688 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.604834 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.604989 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.605150 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.605304 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.605630 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.605917 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.606113 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.606268 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.606542 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.606827 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.607494 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.607728 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.607899 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.608100 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.608365 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.608522 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.608703 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.608928 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.609099 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.609329 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.609481 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.609659 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.609940 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.610098 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.610320 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.610470 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.610686 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.610957 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.611184 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.611351 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.611554 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.611713 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.611875 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.612152 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.612374 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.612543 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.612719 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.612882 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.613078 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.613283 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.613439 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.613685 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.613837 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.613983 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.614283 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.614435 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.614687 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.614867 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.615021 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.615291 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.615456 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.615605 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.615889 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.616043 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.616223 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.616485 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.616662 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.616872 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.617032 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.617178 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.617381 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.617585 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.617752 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.617997 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.618162 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.618357 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.618604 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.618761 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.618991 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.619155 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.619379 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.619695 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.619855 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.620004 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.620249 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.620434 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.620597 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.620818 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.621032 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.621229 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.621389 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.621553 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.621834 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.621985 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.622136 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.622439 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.622600 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.623021 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.623240 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.623396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.623652 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.623815 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.623992 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.624297 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.624453 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.624644 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.624863 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.625021 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.625244 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.625448 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.625603 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.625866 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.626020 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.626179 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.626442 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.626600 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.626795 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.627003 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.627154 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.627424 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.627597 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.627746 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.628015 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.628245 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.628403 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.628590 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.628744 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.628954 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.629142 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.629296 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.629570 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.629746 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.629985 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.630193 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.630340 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.630516 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.630747 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.630919 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.631161 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.631311 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.631457 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.631779 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.631966 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.632126 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.632388 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.632540 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.632774 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.632940 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.633102 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.633400 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.633607 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.633758 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.633943 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.634099 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.634334 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.634580 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 11:52:50.634736 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.635116 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.635547 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.635991 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.636466 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.636884 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.637349 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.637773 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.638225 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.638774 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.639196 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.639610 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.640099 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.640539 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.640947 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.641397 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.641858 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.642268 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.642676 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.643082 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.643546 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.643964 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.644446 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.644986 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.645401 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.645819 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.646343 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.646804 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.647220 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.647678 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.648110 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.648572 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.648999 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.649478 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.649893 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.650330 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.650761 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.651178 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.651602 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.652036 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.652505 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.652977 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.653378 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.654347 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.654898 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.655331 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.655753 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.656245 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.656670 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.657077 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.657489 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.657912 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.658347 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.658810 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.659235 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.659653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.660116 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.660565 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.660980 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.661398 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.661841 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.662307 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.662805 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.663260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.663717 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.664218 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.664689 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.665141 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.665598 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.666044 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.666493 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.666933 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.667370 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.667856 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.668350 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.668803 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.669325 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.670304 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.670755 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.671232 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.671716 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.672199 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.672655 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.673105 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.673574 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.674032 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.674471 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.674918 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.675363 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.675830 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.676446 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.676758 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.677179 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.677594 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.678006 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.678446 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.678864 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.679330 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.679747 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.680157 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.680654 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.681079 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.681541 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.681953 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.682419 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.682835 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.683308 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.683721 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.684142 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.684604 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.685072 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.685494 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.685913 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.686352 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.686873 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.687323 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.687744 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.688201 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.688926 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.689377 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.689797 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.690222 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.690641 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.691089 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.691630 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.692329 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.692804 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.693221 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.693650 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.694097 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.694533 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.695011 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.695490 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.695918 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.696380 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.696818 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.697264 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.697738 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.698160 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.698571 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.698995 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.699432 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.699852 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.700362 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.700812 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.701258 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.701692 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.702119 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.702582 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.702990 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.703359 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.703748 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.704143 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.704608 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.705017 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.705401 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.705955 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.706613 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.707025 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.707469 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.707864 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.708310 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.708852 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.713935 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.714379 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.714778 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.715177 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.715584 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.715980 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.716928 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.717396 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.717848 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.722712 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.723253 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.723650 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.724383 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.724833 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.725269 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.725683 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.726101 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.727541 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.727984 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.728507 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.728907 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.729300 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.729706 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.730106 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.730591 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.731132 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.731616 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.732682 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.733180 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.733624 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.734056 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.734561 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.735089 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.735552 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.736029 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.736387 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.736707 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.737021 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.737336 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.737669 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.737973 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.738282 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.738601 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.738912 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.739234 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.739601 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.739919 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.740396 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.740858 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.741285 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.741742 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.742228 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.742764 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.743485 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.743960 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.744446 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.744988 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.745470 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.746400 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.746758 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.747096 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.747487 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.748083 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.748429 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.748743 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.749057 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.749390 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.749707 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.750079 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.750467 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.750717 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.751033 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.751346 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.751660 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.751978 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.752321 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.752636 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.752950 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.753296 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.753689 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.754025 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.754266 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.754627 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.754951 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.755273 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.755629 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.755948 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.756291 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.756606 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.756917 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.757230 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.757548 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.757920 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.758244 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.758553 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.759293 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.759613 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.759941 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.760301 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.760619 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.760949 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.761274 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.761643 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.761970 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.762353 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.762637 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.762964 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.763428 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.763878 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.764107 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.764382 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.764688 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.764999 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.765320 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.765633 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.765938 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.766245 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.766558 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.766863 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.767283 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.767601 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.767904 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.768235 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.768624 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.768849 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.769152 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.769457 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.769763 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.770066 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.770378 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.770681 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.770987 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.771290 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.771595 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.771903 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.772423 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.772745 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.772955 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.773280 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.773595 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.773924 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.774223 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.774578 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.774932 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.775252 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.775566 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.775906 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.776249 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.776567 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.776882 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.777194 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.777504 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.777814 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.778147 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.778472 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.779383 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.779629 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.779948 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.780304 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.780631 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.780942 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.781269 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.781581 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.781896 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.782203 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.782514 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.782826 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.783141 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.783453 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.783764 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.784258 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.784493 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.784733 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.785058 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.785426 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.785752 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.786081 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.786438 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.786754 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.787100 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.787430 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.787744 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.788058 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.788702 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 11:52:50.799340 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117574) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 11:52:50.799536 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO dbcounter [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Registered counter for database nova_api Oct 04 11:52:50.814645 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:50.822873 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writer thread running {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:50.888832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.context [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf8dfa22-144b-412c-a385-0fe77772a1d0(cell1) {{(pid=117573) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 11:52:50.893192 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:50.893690 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:50.895354 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:50.896256 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:50.896726 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:50.899033 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:50.901303 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO dbcounter [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Registered counter for database nova_cell0 Oct 04 11:52:50.906681 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO dbcounter [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Registered counter for database nova_cell1 Oct 04 11:52:50.916599 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:50.918902 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:50.925697 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writer thread running {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:50.928073 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writer thread running {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:50.947858 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO dbcounter [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Registered counter for database nova_api Oct 04 11:52:50.971939 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_db.sqlalchemy.engines [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:50.980193 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writer thread running {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:51.046424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.context [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf8dfa22-144b-412c-a385-0fe77772a1d0(cell1) {{(pid=117574) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 11:52:51.051272 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_concurrency.lockutils [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:51.051994 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_concurrency.lockutils [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:51.053838 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_concurrency.lockutils [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:51.054727 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_concurrency.lockutils [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 11:52:51.055280 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_concurrency.lockutils [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 11:52:51.057614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_concurrency.lockutils [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117574) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 11:52:51.060119 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO dbcounter [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Registered counter for database nova_cell0 Oct 04 11:52:51.065216 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO dbcounter [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Registered counter for database nova_cell1 Oct 04 11:52:51.075972 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_db.sqlalchemy.engines [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:51.078108 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_db.sqlalchemy.engines [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:51.082121 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO dbcounter [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Registered counter for database nova_cell0 Oct 04 11:52:51.084035 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writer thread running {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:51.087151 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writer thread running {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:51.094995 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_db.sqlalchemy.engines [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:51.101133 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writer thread running {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:51.274796 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO dbcounter [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Registered counter for database nova_cell0 Oct 04 11:52:51.287862 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG oslo_db.sqlalchemy.engines [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117574) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 11:52:51.295224 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writer thread running {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 11:52:51.788746 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: WARNING keystonemiddleware.auth_token [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 11:52:51.803380 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: WARNING keystonemiddleware.auth_token [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 11:52:51.876439 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: WARNING keystonemiddleware.auth_token [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 11:52:51.890390 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: WARNING keystonemiddleware.auth_token [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 11:52:52.391127 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: WARNING keystonemiddleware.auth_token [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 11:52:52.402525 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: WARNING keystonemiddleware.auth_token [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 11:52:52.413094 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ee7b7259c0 pid: 117573 (default app) Oct 04 11:52:52.416844 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:52:52.419004 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003141 Oct 04 11:52:52.420294 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Tue Oct 4 11:52:52 2022] GET /compute/v2.1/ => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:52:52.462845 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: WARNING keystonemiddleware.auth_token [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 11:52:52.469442 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: WARNING keystonemiddleware.auth_token [None req-7bc0d170-0a2f-462d-b2a5-ccedc5683ffe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 11:52:52.475043 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ee7b7259c0 pid: 117574 (default app) Oct 04 11:54:32.077154 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:32.078893 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002994 Oct 04 11:54:32.080084 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:54:32.106110 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_api:SELECT=3 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:32.107979 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_cell0:SELECT=3 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:32.109458 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_cell1:SELECT=3 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:32.110813 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_cell0:SELECT=3 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:33.689983 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-dd022f5f-ddcc-494b-8427-cb06df2ed37a admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:33.743766 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-dd022f5f-ddcc-494b-8427-cb06df2ed37a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.647794 Oct 04 11:54:33.744894 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 4 11:54:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:36.647727 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:36.648762 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-bd9594dd-0f91-49ca-88f3-cd017188e9f5 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 04 11:54:36.653392 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:54:37.336655 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-62a1e877-8401-4d58-80e7-35806f706458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "name": "cirros256", "vcpus": 1}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:37.487125 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-62a1e877-8401-4d58-80e7-35806f706458 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.829711 Oct 04 11:54:37.488400 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:54:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:54:37.511544 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_api:SELECT=3 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:37.512920 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_cell0:SELECT=3 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:37.514722 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_cell1:SELECT=3 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:37.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:54:37.746692 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-a06ce131-66bd-4a1c-93b2-2b085ed04b66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:37.947152 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-a06ce131-66bd-4a1c-93b2-2b085ed04b66 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.444919 Oct 04 11:54:37.947906 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 4 11:54:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:54:41.286324 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-62a1e877-8401-4d58-80e7-35806f706458 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:41.288646 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-62a1e877-8401-4d58-80e7-35806f706458 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003098 Oct 04 11:54:41.289878 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:54:41.959605 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-a7170864-5ce7-436d-b618-a285107a8b94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:42.144578 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-a7170864-5ce7-436d-b618-a285107a8b94 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.846524 Oct 04 11:54:42.145576 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:54:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:54:42.165102 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-c08ebf52-7c9d-4ee9-aa09-96255ce7c5f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:42.345471 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-c08ebf52-7c9d-4ee9-aa09-96255ce7c5f9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.189297 Oct 04 11:54:42.348371 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 4 11:54:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:45.247126 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-a7170864-5ce7-436d-b618-a285107a8b94 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:45.248230 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-a7170864-5ce7-436d-b618-a285107a8b94 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 04 11:54:45.248916 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:54:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:54:45.836787 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-2ecce20f-0c61-4a4d-9686-ffdef277b97f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:45.938328 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-2ecce20f-0c61-4a4d-9686-ffdef277b97f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.681178 Oct 04 11:54:45.939027 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:54:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:54:45.958857 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-88da322e-e524-4462-8128-92225d1d1fef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:46.089667 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-88da322e-e524-4462-8128-92225d1d1fef admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136502 Oct 04 11:54:46.090529 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 4 11:54:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:49.432491 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-2ecce20f-0c61-4a4d-9686-ffdef277b97f admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:49.434399 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-2ecce20f-0c61-4a4d-9686-ffdef277b97f admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 Oct 04 11:54:49.439351 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:54:49 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:54:50.015085 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-bf8d61d9-cfc1-4b5b-876b-31de58b0fc24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G"}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:50.106440 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-bf8d61d9-cfc1-4b5b-876b-31de58b0fc24 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.663703 Oct 04 11:54:50.107203 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:54:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:54:50.120539 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-489048fa-b1e1-4d91-a8ef-2af174f0ca23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:50.300504 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-489048fa-b1e1-4d91-a8ef-2af174f0ca23 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.183734 Oct 04 11:54:50.301561 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 4 11:54:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:54:53.133099 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-bf8d61d9-cfc1-4b5b-876b-31de58b0fc24 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:53.134716 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-bf8d61d9-cfc1-4b5b-876b-31de58b0fc24 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Oct 04 11:54:53.135216 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:54:53.788845 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-bf902a08-7958-41b4-829b-bebd1e56cfc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:53.868700 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-bf902a08-7958-41b4-829b-bebd1e56cfc6 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.723407 Oct 04 11:54:53.873455 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:54:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:54:53.882980 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-d757beb1-6ffa-4f4f-95d6-20cfef666943 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:54:53.969100 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-d757beb1-6ffa-4f4f-95d6-20cfef666943 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090070 Oct 04 11:54:53.969832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Oct 4 11:54:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:54:58.344594 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-bf902a08-7958-41b4-829b-bebd1e56cfc6 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:58.345617 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-bf902a08-7958-41b4-829b-bebd1e56cfc6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 04 11:54:58.346040 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:54:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:54:59.010983 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-1d099b33-a297-46bf-a0bf-09dd59b3527d admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:54:59.041860 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-1d099b33-a297-46bf-a0bf-09dd59b3527d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.687732 Oct 04 11:54:59.042667 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 4 11:54:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:01.994879 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-bf902a08-7958-41b4-829b-bebd1e56cfc6 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:01.995800 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-bf902a08-7958-41b4-829b-bebd1e56cfc6 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Oct 04 11:55:01.996246 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:55:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:55:02.622924 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-408ca923-713f-4f73-8fb7-1563bb8d4a02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:02.745453 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-408ca923-713f-4f73-8fb7-1563bb8d4a02 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.741273 Oct 04 11:55:02.746530 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:55:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:55:02.761414 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-c5d66311-56a3-40bd-be78-86d62eb0538f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:02.768306 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:02.934680 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-c5d66311-56a3-40bd-be78-86d62eb0538f admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.177509 Oct 04 11:55:02.936627 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 4 11:55:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:06.423453 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-408ca923-713f-4f73-8fb7-1563bb8d4a02 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:06.425138 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-408ca923-713f-4f73-8fb7-1563bb8d4a02 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002499 Oct 04 11:55:06.425859 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:07.241102 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-3cb635d8-3100-491d-9575-15b4ff058e73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:07.352761 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-3cb635d8-3100-491d-9575-15b4ff058e73 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.918533 Oct 04 11:55:07.368391 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:55:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:55:07.377827 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-f5f8df0f-fb71-4b5b-a9dc-0bd33da383e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:07.494897 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-f5f8df0f-fb71-4b5b-a9dc-0bd33da383e5 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123342 Oct 04 11:55:07.498258 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 4 11:55:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:55:11.145581 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-3cb635d8-3100-491d-9575-15b4ff058e73 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:11.156896 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-3cb635d8-3100-491d-9575-15b4ff058e73 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 04 11:55:11.156896 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:55:11.802631 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-aa414c81-8772-4748-8164-39dbc31fe477 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:11.816462 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:11.940152 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-aa414c81-8772-4748-8164-39dbc31fe477 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.783348 Oct 04 11:55:11.942110 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:55:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:55:11.963855 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-33eb15d9-9c6a-45fe-b17c-f88024ddb0c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:12.102629 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-33eb15d9-9c6a-45fe-b17c-f88024ddb0c7 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.145357 Oct 04 11:55:12.103839 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 4 11:55:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:55:14.986454 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-aa414c81-8772-4748-8164-39dbc31fe477 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:14.988334 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-aa414c81-8772-4748-8164-39dbc31fe477 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Oct 04 11:55:14.990005 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:55:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:55:15.617294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-8fb8c167-2280-4d66-be9b-8267dc98c117 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:15.704435 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-8fb8c167-2280-4d66-be9b-8267dc98c117 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.707927 Oct 04 11:55:15.705287 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:55:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:55:15.718555 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-ce8a71ce-fdb0-4078-ae8f-e257f71ecf8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:15.854605 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-ce8a71ce-fdb0-4078-ae8f-e257f71ecf8a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140135 Oct 04 11:55:15.855733 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 4 11:55:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:55:19.041830 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-8fb8c167-2280-4d66-be9b-8267dc98c117 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:19.042754 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-8fb8c167-2280-4d66-be9b-8267dc98c117 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 04 11:55:19.043156 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:55:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:19.518624 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-e3dcf9a3-3e66-4f4a-9fcf-4d03a4fe5454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "disk": 160}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:19.604006 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-e3dcf9a3-3e66-4f4a-9fcf-4d03a4fe5454 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.552755 Oct 04 11:55:19.604784 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Oct 4 11:55:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:55:19.621405 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-5a0f4d78-448d-477e-95ff-852a8a011336 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:19.753838 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-5a0f4d78-448d-477e-95ff-852a8a011336 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139372 Oct 04 11:55:19.768545 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Oct 4 11:55:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:55:34.621082 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-e3dcf9a3-3e66-4f4a-9fcf-4d03a4fe5454 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:34.622223 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-e3dcf9a3-3e66-4f4a-9fcf-4d03a4fe5454 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Oct 04 11:55:34.622738 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:55:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:34.635462 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:35.128322 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-ebec0895-8044-4dda-a962-3e0e0ddc8459 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:35.151167 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-ebec0895-8044-4dda-a962-3e0e0ddc8459 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.520755 Oct 04 11:55:35.151740 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 4 11:55:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:36.548797 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-e3dcf9a3-3e66-4f4a-9fcf-4d03a4fe5454 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:36.549829 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-e3dcf9a3-3e66-4f4a-9fcf-4d03a4fe5454 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 04 11:55:36.550254 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:37.122264 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-84c0f7b4-4fc7-452a-9c03-5cf3a50b0602 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:37.128432 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.wsgi [None req-84c0f7b4-4fc7-452a-9c03-5cf3a50b0602 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-84c0f7b4-4fc7-452a-9c03-5cf3a50b0602 admin admin] Request method failure captured: Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Accept: application/json Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Accept-Encoding: gzip, deflate Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Connection: keep-alive Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Content-Length: 0 Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Host: 10.222.0.15 Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Openstack-Api-Version: compute 2.92 Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Openstack-System-Scope: None Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: User-Agent: python-novaclient Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Auth-Token: gAAAAABjPB84Po86QLjkqhhveAdoT3Wgdo9Sl5528TodXe6oQcjNZyw4SGLm-W1iTOjZXe2MAtsA_WIwuxdBaKi5NgjIxDF0q1vcflXo57JNRwuk4kaOWxZyti7ahJKzYum_hEvuzHrPa9DHeRlPudjKEKk0jIWUEcNN5fT0xiebQ1xzuKxxLME Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Domain-Id: None Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Domain-Name: None Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Identity-Status: Confirmed Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Is-Admin-Project: True Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Domain-Id: default Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Domain-Name: Default Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Name: admin Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Role: admin,reader,member Oct 04 11:55:37.131765 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Roles: admin,reader,member Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a155f451dd324796b4bda64d212b8b97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}] Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant: admin Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant-Name: admin Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User: admin Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Domain-Id: default Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Domain-Name: Default Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Id: 374ef1a08ea74e7cb0bf480e25c8cdd4 Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Name: admin Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: method: > Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: exception: Flavor 42 could not be found. Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: action_args: {'id': '42'} Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:37.133355 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:37.134687 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.137069 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-84c0f7b4-4fc7-452a-9c03-5cf3a50b0602 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:37.139370 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-84c0f7b4-4fc7-452a-9c03-5cf3a50b0602 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.433910 Oct 04 11:55:37.139370 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 4 11:55:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:37.143281 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-4815c87c-c329-404e-abde-72a3e15772ea admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:37.147611 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:55:37.167951 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-4815c87c-c329-404e-abde-72a3e15772ea admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028186 Oct 04 11:55:37.168544 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 4 11:55:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:37.179616 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-63bc0beb-cb1a-4917-94cb-46d4a5672379 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:37.201968 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-63bc0beb-cb1a-4917-94cb-46d4a5672379 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026909 Oct 04 11:55:37.202514 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 4 11:55:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:37.212877 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-d0a22a50-54b2-4956-adbe-bbf25dba39f3 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:37.218600 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.wsgi [None req-d0a22a50-54b2-4956-adbe-bbf25dba39f3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-d0a22a50-54b2-4956-adbe-bbf25dba39f3 admin admin] Request method failure captured: Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Accept: application/json Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Accept-Encoding: gzip, deflate Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Connection: keep-alive Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Content-Length: 0 Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Host: 10.222.0.15 Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Openstack-Api-Version: compute 2.92 Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Openstack-System-Scope: None Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: User-Agent: python-novaclient Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Auth-Token: gAAAAABjPB84Po86QLjkqhhveAdoT3Wgdo9Sl5528TodXe6oQcjNZyw4SGLm-W1iTOjZXe2MAtsA_WIwuxdBaKi5NgjIxDF0q1vcflXo57JNRwuk4kaOWxZyti7ahJKzYum_hEvuzHrPa9DHeRlPudjKEKk0jIWUEcNN5fT0xiebQ1xzuKxxLME Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Domain-Id: None Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Domain-Name: None Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Identity-Status: Confirmed Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Is-Admin-Project: True Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Domain-Id: default Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Domain-Name: Default Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Name: admin Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Role: admin,reader,member Oct 04 11:55:37.221851 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Roles: admin,reader,member Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a155f451dd324796b4bda64d212b8b97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}] Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant: admin Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant-Name: admin Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User: admin Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Domain-Id: default Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Domain-Name: Default Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Id: 374ef1a08ea74e7cb0bf480e25c8cdd4 Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Name: admin Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: method: > Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: exception: Flavor 42 could not be found. Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: action_args: {'id': '42'} Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:37.223396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:37.224396 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:37.225552 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-d0a22a50-54b2-4956-adbe-bbf25dba39f3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:37.227306 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-d0a22a50-54b2-4956-adbe-bbf25dba39f3 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014460 Oct 04 11:55:37.227306 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 4 11:55:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:38.456690 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-63bc0beb-cb1a-4917-94cb-46d4a5672379 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:38.458050 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-63bc0beb-cb1a-4917-94cb-46d4a5672379 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Oct 04 11:55:38.458273 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:39.044628 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-024804be-99e3-4cee-a65a-6a348bb831c8 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:39.050078 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.wsgi [None req-024804be-99e3-4cee-a65a-6a348bb831c8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-024804be-99e3-4cee-a65a-6a348bb831c8 admin admin] Request method failure captured: Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Accept: application/json Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Accept-Encoding: gzip, deflate Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Connection: keep-alive Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Content-Length: 0 Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Host: 10.222.0.15 Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Openstack-Api-Version: compute 2.92 Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Openstack-System-Scope: None Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: User-Agent: python-novaclient Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Auth-Token: gAAAAABjPB86oX9B9sY4UXbEy8hZs1AeVIazzz5fo3LP839qAtdhGsvyU5FAXju4UuzbxfYQjVLNpumJmkOxTsQXWly_r6PfN4tx2CCNwiwN-DmB3CHG8vP_Mtcc39bUvJDGgfAP3NYDwYU6kkCkGmG0QYwnHvYchImyAJCvUZ6DomuVjymOZo0 Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Domain-Id: None Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Domain-Name: None Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Identity-Status: Confirmed Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Is-Admin-Project: True Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Domain-Id: default Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Domain-Name: Default Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Name: admin Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Role: admin,reader,member Oct 04 11:55:39.051637 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Roles: admin,reader,member Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a155f451dd324796b4bda64d212b8b97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}] Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant: admin Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant-Name: admin Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User: admin Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Domain-Id: default Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Domain-Name: Default Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Id: 374ef1a08ea74e7cb0bf480e25c8cdd4 Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Name: admin Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: method: > Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: exception: Flavor 84 could not be found. Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: action_args: {'id': '84'} Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:39.053290 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:39.054832 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.056385 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-024804be-99e3-4cee-a65a-6a348bb831c8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:39.057657 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-024804be-99e3-4cee-a65a-6a348bb831c8 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.443832 Oct 04 11:55:39.057657 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 4 11:55:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:39.072054 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-9f07fd17-b2c3-420a-938b-a7a477cc4a37 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:39.101529 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-9f07fd17-b2c3-420a-938b-a7a477cc4a37 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.037211 Oct 04 11:55:39.102608 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 4 11:55:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:39.112748 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-b4908069-9710-4ec0-a3e3-6dc2b8a412c2 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:39.135141 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-b4908069-9710-4ec0-a3e3-6dc2b8a412c2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025678 Oct 04 11:55:39.136145 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 4 11:55:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:39.149240 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-a76b6236-6b8d-474e-8326-b8f88ea90d15 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:39.154873 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.wsgi [None req-a76b6236-6b8d-474e-8326-b8f88ea90d15 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-a76b6236-6b8d-474e-8326-b8f88ea90d15 admin admin] Request method failure captured: Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Accept: application/json Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Accept-Encoding: gzip, deflate Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Connection: keep-alive Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Content-Length: 0 Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Host: 10.222.0.15 Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Openstack-Api-Version: compute 2.92 Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Openstack-System-Scope: None Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: User-Agent: python-novaclient Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Auth-Token: gAAAAABjPB86oX9B9sY4UXbEy8hZs1AeVIazzz5fo3LP839qAtdhGsvyU5FAXju4UuzbxfYQjVLNpumJmkOxTsQXWly_r6PfN4tx2CCNwiwN-DmB3CHG8vP_Mtcc39bUvJDGgfAP3NYDwYU6kkCkGmG0QYwnHvYchImyAJCvUZ6DomuVjymOZo0 Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Domain-Id: None Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Domain-Name: None Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Identity-Status: Confirmed Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Is-Admin-Project: True Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Domain-Id: default Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Domain-Name: Default Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Name: admin Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Role: admin,reader,member Oct 04 11:55:39.156424 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Roles: admin,reader,member Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a155f451dd324796b4bda64d212b8b97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}] Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant: admin Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant-Name: admin Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User: admin Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Domain-Id: default Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Domain-Name: Default Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Id: 374ef1a08ea74e7cb0bf480e25c8cdd4 Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Name: admin Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: method: > Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: exception: Flavor 84 could not be found. Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: action_args: {'id': '84'} Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:39.158871 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:39.160759 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:39.163087 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-a76b6236-6b8d-474e-8326-b8f88ea90d15 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:39.165492 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-a76b6236-6b8d-474e-8326-b8f88ea90d15 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012416 Oct 04 11:55:39.165492 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Oct 4 11:55:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 11:55:40.476915 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-b4908069-9710-4ec0-a3e3-6dc2b8a412c2 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:40.477919 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-b4908069-9710-4ec0-a3e3-6dc2b8a412c2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Oct 04 11:55:40.478324 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:55:41.050362 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-ba30f224-0bf0-47d5-8e99-51a3335f36b2 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:41.057020 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.wsgi [None req-ba30f224-0bf0-47d5-8e99-51a3335f36b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-ba30f224-0bf0-47d5-8e99-51a3335f36b2 admin admin] Request method failure captured: Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Accept: application/json Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Accept-Encoding: gzip, deflate Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Connection: keep-alive Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Content-Length: 0 Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Host: 10.222.0.15 Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Openstack-Api-Version: compute 2.92 Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Openstack-System-Scope: None Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: User-Agent: python-novaclient Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Auth-Token: gAAAAABjPB88kIutlVxbOVAn1nRznXjgxp1BAOngfbsCy_hGXL5KyR7SsotDFb1MTX4UOCQRJs-sjK9o2-fkm2KhJJL3e0gG01KL39Js-1zI9-D2HPvoRm2j3BcGchvAJu3XaBK4GUjhxhQ2EziX9U5kcNkpo6dpFl6xljKp92DtlxoBWZhRZjo Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Domain-Id: None Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Domain-Name: None Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Identity-Status: Confirmed Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Is-Admin-Project: True Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Domain-Id: default Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Domain-Name: Default Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Project-Name: admin Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Role: admin,reader,member Oct 04 11:55:41.058614 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Roles: admin,reader,member Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a155f451dd324796b4bda64d212b8b97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}] Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant: admin Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-Tenant-Name: admin Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User: admin Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Domain-Id: default Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Domain-Name: Default Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Id: 374ef1a08ea74e7cb0bf480e25c8cdd4 Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: X-User-Name: admin Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: method: > Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: exception: Flavor 451 could not be found. Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: action_args: {'id': '451'} Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:41.060294 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:41.061260 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.062653 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-ba30f224-0bf0-47d5-8e99-51a3335f36b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117574) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:41.063933 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-ba30f224-0bf0-47d5-8e99-51a3335f36b2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.440313 Oct 04 11:55:41.063933 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 4 11:55:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 11:55:41.070624 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-993efb46-58a7-43af-99c0-386312751c52 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:41.087541 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-993efb46-58a7-43af-99c0-386312751c52 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021138 Oct 04 11:55:41.088095 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 4 11:55:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:41.098264 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:41.115319 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020648 Oct 04 11:55:41.115909 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Oct 4 11:55:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:55:41.127973 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-12637149-fefe-4627-bdf9-9f8d360cb932 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:41.133467 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.wsgi [None req-12637149-fefe-4627-bdf9-9f8d360cb932 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-12637149-fefe-4627-bdf9-9f8d360cb932 admin admin] Request method failure captured: Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Accept: application/json Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Accept-Encoding: gzip, deflate Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Connection: keep-alive Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Content-Length: 0 Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Host: 10.222.0.15 Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Openstack-Api-Version: compute 2.92 Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Openstack-System-Scope: None Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: User-Agent: python-novaclient Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Auth-Token: gAAAAABjPB88kIutlVxbOVAn1nRznXjgxp1BAOngfbsCy_hGXL5KyR7SsotDFb1MTX4UOCQRJs-sjK9o2-fkm2KhJJL3e0gG01KL39Js-1zI9-D2HPvoRm2j3BcGchvAJu3XaBK4GUjhxhQ2EziX9U5kcNkpo6dpFl6xljKp92DtlxoBWZhRZjo Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Domain-Id: None Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Domain-Name: None Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Identity-Status: Confirmed Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Is-Admin-Project: True Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Domain-Id: default Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Domain-Name: Default Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Project-Name: admin Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Role: admin,reader,member Oct 04 11:55:41.134981 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Roles: admin,reader,member Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a155f451dd324796b4bda64d212b8b97", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a155f451dd324796b4bda64d212b8b97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a155f451dd324796b4bda64d212b8b97"}]}] Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant: admin Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant-Id: a155f451dd324796b4bda64d212b8b97 Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-Tenant-Name: admin Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User: admin Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Domain-Id: default Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Domain-Name: Default Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Id: 374ef1a08ea74e7cb0bf480e25c8cdd4 Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: X-User-Name: admin Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: method: > Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: exception: Flavor 451 could not be found. Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: action_args: {'id': '451'} Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 11:55:41.136479 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:41.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: ERROR nova.api.openstack.wsgi Oct 04 11:55:41.138460 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-12637149-fefe-4627-bdf9-9f8d360cb932 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 11:55:41.139587 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-12637149-fefe-4627-bdf9-9f8d360cb932 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012573 Oct 04 11:55:41.139587 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 4 11:55:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 11:55:42.439909 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:42.440933 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 04 11:55:42.441334 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:43.105878 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-926887d8-b18f-48b6-8af4-cbff72fdb13a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:43.214996 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-926887d8-b18f-48b6-8af4-cbff72fdb13a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.631750 Oct 04 11:55:43.215485 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 4 11:55:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 11:55:44.536150 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:44.537979 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002544 Oct 04 11:55:44.538771 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:45.274868 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-39c23771-b04c-408c-98d1-a8dad2874149 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:45.343446 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-39c23771-b04c-408c-98d1-a8dad2874149 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.520575 Oct 04 11:55:45.344014 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 4 11:55:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:55:46.663075 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:46.664656 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002310 Oct 04 11:55:46.665416 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:47.310373 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-671363fc-4de1-4ea8-8063-6056207a84ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:47.415458 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-671363fc-4de1-4ea8-8063-6056207a84ee admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.607171 Oct 04 11:55:47.415909 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 4 11:55:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:55:48.732887 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:48.733887 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 04 11:55:48.734281 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 11:55:49.336639 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-7ebf2261-ec67-47ba-be3c-43b75b4b25f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 11:55:49.445749 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-7ebf2261-ec67-47ba-be3c-43b75b4b25f8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.557562 Oct 04 11:55:49.446566 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Oct 4 11:55:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 11:55:50.833189 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:50.834363 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001827 Oct 04 11:55:50.835589 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 11:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:55:51.493525 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-fa7a49a8-bcb8-4741-8814-f2ba6a8b7cc2 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:55:51.536474 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-fa7a49a8-bcb8-4741-8814-f2ba6a8b7cc2 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.556135 Oct 04 11:55:51.537550 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Tue Oct 4 11:55:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 11:56:54.814456 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:54.816510 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-08cc1cfe-75cc-4d14-9fca-e0278ce09dbc admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002565 Oct 04 11:56:54.817942 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Tue Oct 4 11:56:54 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 11:56:54.827350 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:55.303835 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-82604953-3698-4d57-9a35-8650b7808112 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:55.325845 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-82604953-3698-4d57-9a35-8650b7808112 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.499932 Oct 04 11:56:55.326419 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Oct 4 11:56:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 11:56:55.363134 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_api:SELECT=14 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 11:56:55.367593 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-409ca891-851f-4413-a86a-b6bbefd12351 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:55.375322 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-409ca891-851f-4413-a86a-b6bbefd12351 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013523 Oct 04 11:56:55.375806 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Oct 4 11:56:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 11:56:55.389343 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-4a85c005-f1b1-43d2-8a89-01fc0ab86728 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:55.397686 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-4a85c005-f1b1-43d2-8a89-01fc0ab86728 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011972 Oct 04 11:56:55.398502 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Oct 4 11:56:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:56:55.411195 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:55.419320 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011760 Oct 04 11:56:55.419894 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Oct 4 11:56:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 11:56:55.433124 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-01c71737-84af-4694-8514-c3dd24f3e33a admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 11:56:55.440915 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-01c71737-84af-4694-8514-c3dd24f3e33a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011612 Oct 04 11:56:55.441487 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Oct 4 11:56:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:00:16.266889 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:16.267923 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 04 12:00:16.268385 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 12:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:00:16.412260 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_api:SELECT=6 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:16.593013 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:16.601379 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:16.602239 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:16.603002 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:16.604320 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:16.605145 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:16.605882 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:16.669527 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-c0dadaad-8372-4e16-b00b-d71cc3dd201b admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.257506 Oct 04 12:00:16.670467 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 4 12:00:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:00:17.863474 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:17.865604 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002661 Oct 04 12:00:17.866390 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 12:00:17 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:00:18.201831 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:18.205583 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:18.206132 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:18.206613 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:18.207375 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:18.207898 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:18.208360 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:18.231382 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-141f8403-aee7-407f-90ca-92dd648232af admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.089272 Oct 04 12:00:18.232004 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 4 12:00:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:00:29.816040 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:29.817125 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Oct 04 12:00:29.817527 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 12:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:00:29.967945 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_cell0:SELECT=4 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:29.968712 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_cell1:SELECT=4 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:29.969350 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG dbcounter [-] [117573] Writing DB stats nova_api:SELECT=8 {{(pid=117573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:00:30.027306 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:30.028297 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:30.028815 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:30.029243 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:30.029969 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:30.030415 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:30.030826 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:30.057917 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-45eaf0d0-9ba0-43ad-a3e6-f73bd7480d55 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.094639 Oct 04 12:00:30.058493 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 4 12:00:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:00:31.202584 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG nova.api.openstack.wsgi [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] Calling method '>' {{(pid=117574) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:31.203594 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: INFO nova.api.openstack.requestlog [None req-8c691690-a395-44e2-aecd-f6daec464c43 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 04 12:00:31.204028 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: [pid: 117574|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Oct 4 12:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:00:31.423849 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG nova.api.openstack.wsgi [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] Calling method '>' {{(pid=117573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:00:31.427397 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:31.427879 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:31.428347 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:31.429071 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:00:31.429514 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:00:31.429926 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: DEBUG oslo_concurrency.lockutils [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:00:31.454294 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: INFO nova.api.openstack.requestlog [None req-5bcc6346-dcf4-469d-b24e-f560a3fab96d admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.109593 Oct 04 12:00:31.454882 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: [pid: 117573|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Oct 4 12:00:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:01:35.346174 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: Tue Oct 4 12:01:35 2022 - graceful shutdown triggered... Oct 04 12:01:35.346334 dv-cinder-860212-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 12:01:35.347756 dv-cinder-860212-2-iscsi devstack@n-api.service[117573]: Gracefully killing worker 1 (pid: 117573)... Oct 04 12:01:35.348439 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: Gracefully killing worker 2 (pid: 117574)... Oct 04 12:01:35.485243 dv-cinder-860212-2-iscsi devstack@n-api.service[117574]: DEBUG dbcounter [-] [117574] Writing DB stats nova_api:SELECT=4 {{(pid=117574) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:01:36.347714 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: worker 1 buried after 1 seconds Oct 04 12:01:36.347714 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: worker 2 buried after 1 seconds Oct 04 12:01:36.347714 dv-cinder-860212-2-iscsi devstack@n-api.service[117572]: goodbye to uWSGI. Oct 04 12:01:36.349619 dv-cinder-860212-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 04 12:01:36.350233 dv-cinder-860212-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 12:01:36.353416 dv-cinder-860212-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 12:01:36.375705 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 12:01:36 2022] *** Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: nodename: dv-cinder-860212-2-iscsi Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: machine: x86_64 Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: clock source: unix Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: pcre jit disabled Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: detected number of CPU cores: 4 Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: current working directory: / Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: detected binary path: /usr/bin/uwsgi-core Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: your processes number limit is 47680 Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: your memory page size is 4096 bytes Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: detected max file descriptor number: 2048 Oct 04 12:01:36.379205 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: lock engine: pthread robust mutexes Oct 04 12:01:36.386361 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: thunder lock: enabled Oct 04 12:01:36.386361 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 12:01:36.386361 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 12:01:36.421659 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: Python main interpreter initialized at 0x55dfa02569c0 Oct 04 12:01:36.421659 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: python threads support enabled Oct 04 12:01:36.421659 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: your server socket listen backlog is limited to 100 connections Oct 04 12:01:36.421659 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: your mercy for graceful operations on workers is 90 seconds Oct 04 12:01:36.427173 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 12:01:36.427173 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: *** Operational MODE: preforking *** Oct 04 12:01:36.427173 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: *** uWSGI is running in multiple interpreter mode *** Oct 04 12:01:36.427173 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: spawned uWSGI master process (pid: 133065) Oct 04 12:01:36.427173 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: spawned uWSGI worker 1 (pid: 133083, cores: 1) Oct 04 12:01:36.427173 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: spawned uWSGI worker 2 (pid: 133084, cores: 1) Oct 04 12:01:36.427173 dv-cinder-860212-2-iscsi devstack@n-api.service[133065]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 12:01:36.422706 dv-cinder-860212-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 04 12:01:37.157291 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 12:01:37.203375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 12:01:38.394152 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:01:38.394152 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: from cryptography.utils import int_from_bytes Oct 04 12:01:38.395153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:01:38.395153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: from cryptography.utils import int_from_bytes Oct 04 12:01:38.896707 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:01:38.896707 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: from cryptography.utils import int_from_bytes Oct 04 12:01:38.897406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 12:01:38.897406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: from cryptography.utils import int_from_bytes Oct 04 12:01:40.956971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 12:01:40.957769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 12:01:40.957769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 12:01:40.958073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 12:01:40.958519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 12:01:40.958800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.959105 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.959450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.959783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.960120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.960466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.960913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.961465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.961988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.963316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.964257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.965007 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-2-iscsi {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.965408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.965768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.966095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.966426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.966743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.967073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.967388 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.967911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.968689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.969177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.969746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.970278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.970758 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.971241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.971733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.972245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.972728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.973217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.973785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-2-iscsi {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.974278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.974749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.975243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.975678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.976000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.976340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.976699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.977234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.977416 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.977731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.978590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.978921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.979246 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.979554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.979868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.980208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.980606 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.980860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.981184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.981510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.981838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.982099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.982365 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.982884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.983316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.983566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.984074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.984436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.984740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.985053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.985366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.985677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.985986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.986296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.986605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.986916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.987238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.987597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.987997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.988278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.988815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.989060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.989292 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.989597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.989946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.990269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.990583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.990900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.991409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.991719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.992031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.992387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.992848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.993122 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.993471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.993743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.994028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.994693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.994693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.995175 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.995419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.995670 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.995934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.996397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.996397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.996930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.997176 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.997632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.997632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.998998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.998998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.998998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.998998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.999962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.999962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:40.999962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.000677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.000677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.001825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.001825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.001825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.001825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.002773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.002773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.002773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.004556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.004556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.004556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.004556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.004556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.004556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.006052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.006052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.006052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.006052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.010624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.013473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.015414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.017433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.019331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.023076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.025032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.026747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.029080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.033274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.035149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.036929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.038666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.038666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.038666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.038666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.038666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.038666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.038666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.043109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.045095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.047271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.050559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.050559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.050559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.050559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.050559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.051664 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.051664 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.051664 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.053730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.053730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.053730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.053730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.053730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.053730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.053730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.055279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.055279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.055279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.055279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.055279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.056578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.056578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.056578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.056578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.057453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.057453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.057453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.058103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.058103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.058536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.058764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.059033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.059299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.059609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.059931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.060270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.060584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.060914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.061195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.061506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.061815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.062113 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.063385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.063385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.063385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.063385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.064684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.064684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.064684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.064684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.065625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.065625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.065625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.066338 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.066338 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.066783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.066783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.067304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.067588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.067853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.068083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.068428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.068742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.069076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.069396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.069710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.070026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.070433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.070698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.070954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.071260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.071563 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.072437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.072871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.074199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.074199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.074199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.074878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.074878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.075342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.075342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.075811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.076089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.076404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.076666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.076910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.077228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.077514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.077821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.078124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.078428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.078811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.079119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.079438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.079755 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.080061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.080397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.080807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.081070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.081303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.081611 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.081928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.082234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.082565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.082974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.083230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.084500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.084500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.084500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.084500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.085483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.085483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.085483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.086214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.086214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.086715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.086715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.087182 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.087478 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.087739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.088017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.088542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.088815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.089054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.089275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.089592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.089897 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.090249 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.090567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.090914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.091242 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.091483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.091774 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.092089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.092433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.092781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.093136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.093406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.094711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.094711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.094711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.094711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.095694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.095694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.095694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.096438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.096438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.096438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.097159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.097159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.097627 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.097627 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.098090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.098335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.098733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.098981 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.099218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.099462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.099716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.100037 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.100370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.100632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.100947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.101408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.101669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.101933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.102204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.102494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.102803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.104927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.104927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.104927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.104927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.105899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.105899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.105899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.106622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.106622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.106622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.107300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.107300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.107812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.107812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.108321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.108571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.108964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.109205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.109520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.109771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.110014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.110328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.110574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.110996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.111254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.111515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.111790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.112329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.112581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.112852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.113126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.113373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.113680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.113931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.115037 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.115037 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.115037 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.115975 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.115975 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.115975 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.116734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.116734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.116734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.117495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.117495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.117977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.118213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.118445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.118763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.119159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.119457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.119722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.119980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.120335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.120777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.121091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.121408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.121772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.122050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.122489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.122752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.123024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.123284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.123598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.123896 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.125149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.125149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.125149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.126155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.126155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.126155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.126883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.126883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.127352 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.127352 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.127805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.128060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.128546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.129088 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.129483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.129483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.129972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.130234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.130489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.130811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.131073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.131510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.131779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.132103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.132466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.132856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.133094 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.133413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.133744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.134052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.135635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.135635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.135635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.136713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.136713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.136713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.137400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.137400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.137400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.138080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.138080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.138561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.138561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.139035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.139275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.140584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.140584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.140584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.140584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.141583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.141583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.141583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.142380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.142380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.142380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.143350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.143350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.143839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.143839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.144381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.144381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.144919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.146120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.146120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.146120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.146120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.147306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.147306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.147306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.147306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.148390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.148390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.148390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.148390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.149386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.149386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.149386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.150327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.150327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.150327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.151053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.151053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.151506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.151506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.151971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.152244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.152505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.152749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.152991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.153658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.153658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.154168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.154581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.154581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.155039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.155278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.156316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.156316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.156882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.157397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.157726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.158054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.158377 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.158699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.159054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.159406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.159729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.160266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.160546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.160817 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.161061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.161416 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.161719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.162049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.162369 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.162687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.163006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.163496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.163766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.164017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.164341 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.164635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.165026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.165431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.167064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.167064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.167064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.167956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.167956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.167956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.168730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.168730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.168730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.169399 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.169399 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.169859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.170089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.170634 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.170941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.171290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.171617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.171949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.172300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.172610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.172949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.173256 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.173680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.173955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.174211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.174532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.174779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.175086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.175372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.175697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.176006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.177232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.177232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.177954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.177954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.177954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.178752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.178752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.179260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.179260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.179754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.180004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.180307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.180615 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.181016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.181016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.181592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.181862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.182125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.182432 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.183591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.183591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.183591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.183591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.184708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.184708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.184708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.185429 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.185429 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.185429 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.186115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.186115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.186598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.187626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.187626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.187626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.187626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.188838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.188838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.188838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.189628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.189628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.189628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.190324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.190324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.190782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.191248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.191544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.191791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.192114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.192494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.192832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.193143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.193451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.193885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.194675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.194675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.194985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.195151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.195759 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.195759 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.196031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.196371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.196552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.196916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.197229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.197643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.197909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.198166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.198445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.198872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.199151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.199408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.199762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.200675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.200675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.201222 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.201222 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.201706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.201706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.202198 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.202469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.202723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.202966 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.203392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.203662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.203929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.204258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.204561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.205076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.205340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.205589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.205933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.206353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.206603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.206909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.207309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.207582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.208010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.208301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.208552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.208862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.209283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.209558 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.209884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.210127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.210857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.210857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.211378 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.211378 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.212047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.212047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.213136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.213136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.213829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.213829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.214327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.214327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.214811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.215052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.215473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.215473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.215959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.216260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.216508 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.216767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.217045 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.217311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.217603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.218077 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.218338 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.218604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.218870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.219155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.219565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.219804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.220111 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.220418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.221270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.221270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.221818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.221818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.222496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.222496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.223006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.223006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.223469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.223762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.224154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.224154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.224712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.224988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.225236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.225649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.225906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.226171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.226511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.226765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.227009 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.227252 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.227525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.227828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.228276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.228664 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.228940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.229285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.229737 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.229993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.230314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.230612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.231334 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.231334 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.231851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.231851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133083) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 12:01:41.295559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO dbcounter [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Registered counter for database nova_api Oct 04 12:01:41.318387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_db.sqlalchemy.engines [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:41.329398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writer thread running {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:41.431612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.context [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf8dfa22-144b-412c-a385-0fe77772a1d0(cell1) {{(pid=133083) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 12:01:41.439584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:41.440431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:41.443718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:41.445060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:41.445828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:41.449871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:41.453904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO dbcounter [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Registered counter for database nova_cell0 Oct 04 12:01:41.462209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO dbcounter [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Registered counter for database nova_cell1 Oct 04 12:01:41.477643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_db.sqlalchemy.engines [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:41.481103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_db.sqlalchemy.engines [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:41.487087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writer thread running {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:41.760304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writer thread running {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:41.779301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO dbcounter [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Registered counter for database nova_cell0 Oct 04 12:01:41.792504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_db.sqlalchemy.engines [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133083) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:41.801292 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writer thread running {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:41.899330 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 12:01:41.900868 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 12:01:41.900868 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 12:01:41.901189 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 12:01:41.901407 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 12:01:41.901793 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.902166 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.902460 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.902784 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.903148 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.903433 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.903762 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.904077 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.904442 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.904704 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.905032 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.905358 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-2-iscsi {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.905685 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.905995 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.906309 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.906632 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.906942 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.907265 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.907576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.908092 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.908436 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.908759 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.909052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.909399 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.909716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.910026 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.910352 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.910660 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.910997 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.911333 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.911717 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-2-iscsi {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.912041 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.912532 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.912796 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.913120 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.913435 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.913751 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.914075 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.914404 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.914739 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.915070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.915392 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.915742 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.916068 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.916401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.916716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.917029 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.917348 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.917656 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.917963 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.918213 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.918525 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.918851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.919172 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.919499 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.919753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.920008 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.920359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.920677 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.920980 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.921291 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.921598 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.921907 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.922212 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.922519 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.922843 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.923138 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.923463 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.923777 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.924098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.924437 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.924756 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.925173 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.925427 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.925738 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.926084 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.926405 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.926712 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.927032 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.927357 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.927667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.927978 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.928315 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.928725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.928963 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.929269 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.929521 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.929825 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.930132 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.930453 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.930760 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.931628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.931910 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.932243 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.932554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.932870 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.933182 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.933490 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.933802 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.934110 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.934421 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.934728 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.935042 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.935349 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.935675 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.936017 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.936344 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.936631 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.936939 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.937246 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.937568 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.937874 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.938180 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.938507 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.938815 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.939121 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.939439 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.939750 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.940057 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.940404 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.940710 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.941018 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.941337 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.941645 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.942907 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.943242 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.943554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.943864 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.944378 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.944615 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.944809 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.945093 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.945418 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.945746 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.946058 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.946368 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.946697 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.947601 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 12:01:41.947945 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.948309 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.948662 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.948981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.949319 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.949652 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.949977 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.950295 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.950612 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.950945 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.951261 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.951575 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.951893 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.952393 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.952557 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.952902 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.953199 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.953519 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.953841 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.954156 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.954628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.954919 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.955110 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.955452 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.955777 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.956127 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.956472 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.956801 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.957129 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.957446 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.957759 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.958069 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.958417 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.958730 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.959044 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.959362 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.959677 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.959999 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.960339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.960653 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.960966 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.961279 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.961589 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.961932 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.962254 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.963527 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.963527 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.963527 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.963527 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.964138 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.964138 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.964479 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.964874 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.965064 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.965359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.965678 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.965983 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.966310 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.966643 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.966951 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.967288 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.967598 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.967908 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.968276 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.968555 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.968865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.969178 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.969493 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.969800 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.970126 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.970435 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.970743 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.971070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.971375 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.971684 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.972001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.972339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.973639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.973639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.973639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.973639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.974277 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.974277 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.974575 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.974840 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.975133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.975462 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.975793 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.976111 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.976487 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.976785 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.977091 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.977400 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.977709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.978052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.978356 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.978662 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.978964 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.979268 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.979571 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.979897 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.980250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.980538 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.980842 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.981146 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.981492 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.981801 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.982147 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.982485 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.982809 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.983133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.983444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.983820 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.984071 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.984430 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.984745 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.985059 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.985412 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.985699 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.986023 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.986337 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.986663 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.986972 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.987293 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.987658 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.987916 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.988286 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.988628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.988945 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.989269 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.989582 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.989899 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.990210 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.990522 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.990834 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.991147 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.991465 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.991775 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.992071 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.992422 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.992748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.993059 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.993378 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.994263 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.994538 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.994874 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.995207 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.995520 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.995991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.996160 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.996514 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.996827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.997141 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.997447 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.997758 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.998072 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.998390 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.998703 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.999013 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.999321 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.999635 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:41.999946 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.000281 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.000589 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.000908 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.001240 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.001552 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.001875 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.002196 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.002502 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.002807 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.003130 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.003441 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.004001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.004444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.004756 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.004990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.005271 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.005577 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.005901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.006218 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.006642 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.006846 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.007159 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.007468 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.007791 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.008105 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.008467 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.008778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.009094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.009448 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.009765 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.010091 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.010475 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.010706 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.011020 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.011325 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.011637 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.011986 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.012575 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.012909 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.013227 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.013550 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.013890 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.014211 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.014623 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.014928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.015196 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.015509 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.015818 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.016124 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.016468 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.016779 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.017083 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.017394 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.017699 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.018012 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.018317 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.018621 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.018924 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.019231 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.019547 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.019853 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.020229 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.020500 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.020831 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.021144 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.021446 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.021753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.022055 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.022405 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.022710 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.023052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.023381 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.023723 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.024026 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.024363 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.024718 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.025617 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.025839 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.026114 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.026428 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.027534 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.027534 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.027534 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.028039 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.028039 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.028476 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.028635 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.028911 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.029194 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.029439 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.029757 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.030063 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.030364 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.030676 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.030984 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.031286 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.031595 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.031899 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.032241 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.032551 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.032857 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.033159 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.033469 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.033776 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.034081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.034411 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.034718 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.035216 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.035537 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.035824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.036548 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.036548 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.036884 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.037080 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.037574 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.037865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.038188 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.038495 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.038803 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.039135 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.039420 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.039728 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.040036 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.041053 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.041384 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.041693 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.042025 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.042337 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.042644 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.042950 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.043326 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.043592 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.043901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.044308 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.044619 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.044935 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.045256 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.045572 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.045890 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.046204 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.046504 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.046823 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.047135 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.047454 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.047753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.048269 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.048606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.048925 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.049240 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.049563 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.049886 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.050212 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.050517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.050831 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.051141 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.051451 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.051764 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.052075 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.052418 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.052731 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.053044 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.053357 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.053670 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.053976 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.054294 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.054602 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.054955 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.055240 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.055554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.055856 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.056322 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.056617 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.056957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.057231 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.057677 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.057984 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.058476 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.058789 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.059104 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.059418 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.059737 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.060065 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.060378 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.060822 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.061134 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.061449 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.061763 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.062078 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.062356 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.062678 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.063001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.063310 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.063618 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.063952 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.064277 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.064585 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.064905 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.065339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.065663 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.065972 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.066392 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.066728 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.067018 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.067342 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.067665 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.067994 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.068321 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.068641 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.068929 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.069263 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.069585 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.069900 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.070216 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.070525 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.070846 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.071172 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.071486 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.071841 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.072304 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.072635 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.072950 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.073277 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.073602 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.073918 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.074294 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.074541 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.074852 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.075161 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.075487 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.075800 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.076113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.076457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.076770 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.077075 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.077383 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.077709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.078010 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.078336 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.078652 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.078987 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.079299 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.079613 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.079937 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.080277 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.080611 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.080868 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.081326 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.081518 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.081830 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.082153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.082879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.082879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.083267 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.083475 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.083779 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.084095 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.084401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.084726 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.085051 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.085359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.085674 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.085987 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.086294 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.086600 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.086906 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.087221 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.088049 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.088411 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.088719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.089163 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.089365 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.089667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.089974 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.090284 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.090599 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.091018 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.091266 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.091549 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.091891 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.092226 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.092554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.092872 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.093190 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.093505 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.093829 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.094146 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.094461 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.094779 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.095090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.095407 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.095723 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.096044 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.096674 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.097001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.097318 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.097631 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.097942 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.098259 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.098573 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.098884 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.099202 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.099507 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.099988 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.100359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.100688 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.101015 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.101355 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.101683 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.101978 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.102307 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.102627 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.103084 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.103408 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.103720 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.104038 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.104390 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.104709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.105024 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.105337 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.105657 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.105973 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.106293 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.106605 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.106920 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.107237 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.107571 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.107910 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.108262 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.108588 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.108903 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.109250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.109877 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.110086 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.110425 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.110753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.111076 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.111393 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.111711 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.112351 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.112351 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.113027 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.113027 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.113383 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.113556 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.113865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.114175 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.114481 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.114805 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.115115 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.115696 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.116042 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.116402 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.116732 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.117058 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.117381 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.117685 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.118014 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.118323 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.119164 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.119488 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.119822 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.120309 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.120497 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.120718 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.121032 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.121341 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.121652 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.121958 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.122288 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.122596 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.122937 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.123248 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.123519 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.123827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.124133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.124476 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.124783 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.125098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.125403 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.125719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.126022 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.126338 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.126704 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.127022 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.127325 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.127663 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.127970 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.128293 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.128620 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.129204 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.129531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.129847 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.130146 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.130502 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.130816 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.131412 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.131750 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.132075 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.132541 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.132881 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.133192 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.133619 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.133786 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.134119 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.134537 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.134854 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.135167 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.135479 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.135796 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.136083 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.136432 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.136757 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.137067 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.137378 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.137688 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.137998 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.138309 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.138619 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.138809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: WARNING keystonemiddleware.auth_token [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 12:01:42.139554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.139554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.139554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.140035 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.140229 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.140758 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.140922 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.141094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.141433 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.141712 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.142012 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.142362 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.142645 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.142953 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.143675 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.143993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.144345 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.144673 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.144986 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.145313 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.145637 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.145970 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.146314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.146486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: WARNING keystonemiddleware.auth_token [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 12:01:42.146660 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.146897 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.147244 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.147575 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.147903 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.148313 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.148542 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.148848 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.149161 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.149480 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.150303 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.150657 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.150930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.151210 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.151516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.151822 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.152124 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.152462 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.152772 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.153075 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.153379 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.153689 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.153976 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.154281 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.154585 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.154893 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.155193 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.155498 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.155804 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.156109 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.156444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.156774 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.157108 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.157429 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.157752 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.158066 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.158387 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.158698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.159019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.159339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.159664 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.159974 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.160359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.160801 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.161031 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.161281 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.161608 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.161903 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.162214 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.162576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.162873 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.163184 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.163538 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.163825 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.164155 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.164517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.164795 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.165128 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.166141 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.166493 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.166743 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.166995 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.167303 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.167620 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.167933 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.168347 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.168672 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.168991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.169326 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.169653 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.169964 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.170290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.170615 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.170965 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.171282 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.171626 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.171940 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.172298 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.172614 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.172923 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 12:01:42.173166 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 12:01:42.337501 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO dbcounter [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Registered counter for database nova_api Oct 04 12:01:42.361980 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_db.sqlalchemy.engines [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:42.370880 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writer thread running {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:42.443837 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.context [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bf8dfa22-144b-412c-a385-0fe77772a1d0(cell1) {{(pid=133084) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 12:01:42.448431 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:42.448939 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:42.450560 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:42.451356 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:01:42.451823 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:01:42.453969 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:01:42.456143 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO dbcounter [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Registered counter for database nova_cell0 Oct 04 12:01:42.460793 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO dbcounter [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Registered counter for database nova_cell1 Oct 04 12:01:42.470231 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_db.sqlalchemy.engines [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:42.474151 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_db.sqlalchemy.engines [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:42.482404 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writer thread running {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:42.483939 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writer thread running {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:42.503337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: WARNING keystonemiddleware.auth_token [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 12:01:42.510446 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: WARNING keystonemiddleware.auth_token [None req-3beffb13-a9fe-493b-bc7f-11ba17abff0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 12:01:42.516065 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dfa02569c0 pid: 133083 (default app) Oct 04 12:01:42.638312 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO dbcounter [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Registered counter for database nova_cell0 Oct 04 12:01:42.646835 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_db.sqlalchemy.engines [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 12:01:42.653073 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writer thread running {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 12:01:43.025684 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: WARNING keystonemiddleware.auth_token [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 12:01:43.037369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: WARNING keystonemiddleware.auth_token [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 12:01:43.427487 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: WARNING keystonemiddleware.auth_token [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 12:01:43.435047 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: WARNING keystonemiddleware.auth_token [None req-67623ff8-852c-432c-911b-4d58f8cde89f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 12:01:43.442123 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55dfa02569c0 pid: 133084 (default app) Oct 04 12:02:26.541119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:26.543803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:26.545355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:26.546927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:28.874820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1811f471-43d4-41c3-9c05-1093d9d3501f tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Action: 'create', calling method: .version_select at 0x7f10c4732550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-825091619", "metadata": {"Type": "work"}}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:32.638455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1811f471-43d4-41c3-9c05-1093d9d3501f tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 6.112924 Oct 04 12:02:32.638455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 4 12:02:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 6117 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 12:02:32.672669 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=3 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:32.674253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=3 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:32.675592 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=3 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:32.686042 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=3 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:02:32.964758 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9d9e04e7-6337-4182-ba4b-ca2e7c8cb8b2 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Calling method '.version_select at 0x7f10c4731160>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:35.241605 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9d9e04e7-6337-4182-ba4b-ca2e7c8cb8b2 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d" status: 200 len: 353 microversion: 2.1 time: 2.586468 Oct 04 12:02:35.290830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ddb367cd-cc14-4627-a595-68a86bb182d1 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Calling method '.version_select at 0x7f10c4603430>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:35.291628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 1/2] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:02:32 2022] GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d => generated 353 bytes in 2642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:35.862768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ddb367cd-cc14-4627-a595-68a86bb182d1 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d" status: 200 len: 353 microversion: 2.1 time: 0.595610 Oct 04 12:02:35.878516 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:02:35 2022] GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d => generated 353 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:35.905123 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-fbf98ed6-e2ba-40dd-8e9e-657d9460e3e7 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Calling method '.version_select at 0x7f10c45fa310>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:36.327629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-fbf98ed6-e2ba-40dd-8e9e-657d9460e3e7 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d" status: 202 len: 0 microversion: 2.1 time: 0.431417 Oct 04 12:02:36.341211 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:02:35 2022] DELETE /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:02:36.345567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2a9601f4-4619-418b-b31c-289a845edfab tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Calling method '.version_select at 0x7f10c4603af0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:36.585532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2a9601f4-4619-418b-b31c-289a845edfab tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d" status: 200 len: 352 microversion: 2.1 time: 0.249627 Oct 04 12:02:36.587467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 3/5] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:02:36 2022] GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d => generated 352 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:02:37.612204 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-187cadf3-c3ba-4b1f-9ca7-e11de39b8818 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Calling method '.version_select at 0x7f10c45fa9d0>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:37.687653 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.wsgi [None req-187cadf3-c3ba-4b1f-9ca7-e11de39b8818 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] HTTP exception thrown: Volume 4198afaa-3539-49ef-bbce-271807a16f0d could not be found. Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-187cadf3-c3ba-4b1f-9ca7-e11de39b8818 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Request method failure captured: Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: request: GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d HTTP/1.1 Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept: application/json Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept-Encoding: identity Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Connection: close Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Length: 0 Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Type: application/json Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Host: 10.222.0.15 Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Openstack-System-Scope: None Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: User-Agent: python-urllib3/1.26.12 Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Auth-Token: gAAAAABjPCDSR6UGxaubYcRuHM09A2YETZ7yjmACIl9U-DQKdF91E3keOaaChWKcPa3eJls7QIKP-fkWjDtLSzcObZF1M_Oq8htPCsVlvwr2WsjnM9plERIhgNZrXtVweYIZXd32S9dDXS0JuTnV1O1WP1DA_wrG1m5HyhddXiopxw5IJi-PpDQ Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Id: None Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Name: None Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Identity-Status: Confirmed Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Is-Admin-Project: True Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Id: default Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Name: Default Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Id: 20f2e63652624b738fbc342edeedeb62 Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Name: tempest-VolumesGetTestJSON-34574615 Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Role: reader,member Oct 04 12:02:37.698474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Roles: reader,member Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_20f2e63652624b738fbc342edeedeb62", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20f2e63652624b738fbc342edeedeb62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/20f2e63652624b738fbc342edeedeb62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/20f2e63652624b738fbc342edeedeb62"}]}] Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant: tempest-VolumesGetTestJSON-34574615 Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Id: 20f2e63652624b738fbc342edeedeb62 Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Name: tempest-VolumesGetTestJSON-34574615 Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User: tempest-VolumesGetTestJSON-34574615-project Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Id: default Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Name: Default Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Id: 210399c956734c76bb78137afd48dafd Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Name: tempest-VolumesGetTestJSON-34574615-project Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: method: Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: exception: Volume 4198afaa-3539-49ef-bbce-271807a16f0d could not be found. Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: action_args: {'id': '4198afaa-3539-49ef-bbce-271807a16f0d'} Oct 04 12:02:37.700778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4198afaa-3539-49ef-bbce-271807a16f0d could not be found. (HTTP 404) (Request-ID: req-ea27f219-b38e-4f53-9b3a-e23201e5e266) Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:37.701824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:02:37.703253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4198afaa-3539-49ef-bbce-271807a16f0d could not be found. Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 12:02:37.704698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4198afaa-3539-49ef-bbce-271807a16f0d could not be found. Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4198afaa-3539-49ef-bbce-271807a16f0d could not be found. Oct 04 12:02:37.706113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:02:37.711140 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-187cadf3-c3ba-4b1f-9ca7-e11de39b8818 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] Returning 404 to user: Volume 4198afaa-3539-49ef-bbce-271807a16f0d could not be found. {{(pid=133084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:02:37.713180 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-187cadf3-c3ba-4b1f-9ca7-e11de39b8818 tempest-VolumesGetTestJSON-34574615 tempest-VolumesGetTestJSON-34574615-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d" status: 404 len: 109 microversion: 2.1 time: 0.108374 Oct 04 12:02:37.720956 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 3/6] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:02:37 2022] GET /compute/v2.1/os-volumes/4198afaa-3539-49ef-bbce-271807a16f0d => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:02:43.234058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-47e130d4-9075-48f4-b9ea-1756d8d4c219 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'create', calling method: .version_select at 0x7f10c45a10d0>, body: {"keypair": {"name": "tempest-keypair-717718773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCiJJhq+2RgZKw+NrXgXyenr9RORKocNJMb45Ct+KWgPdwp+Uhn5MOjOkEyaDQt4hFeQKcVle6HlinGSIslDatoWMjaYngPRPW1wdHl+W8L8A1pdcpbqiOW0pYxmpoCrA=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:43.342833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-47e130d4-9075-48f4-b9ea-1756d8d4c219 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for project 4eb043e789a6467db5465a0107f41076. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:02:43.362318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-47e130d4-9075-48f4-b9ea-1756d8d4c219 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for user fd040e13fd6c4b0dbea6a65932f84cb2 and project 4eb043e789a6467db5465a0107f41076. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:02:43.533441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-47e130d4-9075-48f4-b9ea-1756d8d4c219 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.116824 Oct 04 12:02:43.542591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 4/7] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:02:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:02:46.871243 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1450047362", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "networks": [{"uuid": "add09381-a0d2-4f2a-9454-aac9e8a26630"}]}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:47.136223 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] validate_networks() for [('add09381-a0d2-4f2a-9454-aac9e8a26630', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:02:48.234060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-928c490a-df66-49d8-a46b-d207771e499e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: .version_select at 0x7f10c45831f0>, body: {"keypair": {"name": "tempest-keypair-887160329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMs26Vy2mdgb9K1OoCXnrAaDCy0/m3P6aM+q2nkU6gO39a9iMysnncemRIe/RIdiU0h/tgf6rDN+T+YNdCHNieMhnFtOEz/G+uWestj+vAMucVvLu+nKb0zcuVpowWLfw=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:48.269060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-928c490a-df66-49d8-a46b-d207771e499e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:02:48.283632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-928c490a-df66-49d8-a46b-d207771e499e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:02:48.455446 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-928c490a-df66-49d8-a46b-d207771e499e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.937192 Oct 04 12:02:48.479787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 5/8] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:02:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:02:49.867069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-20542526", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d8166dc-91eb-4754-a625-1f72bd32d0b4"}], "security_groups": [{"name": "tempest-securitygroup--2045923955"}], "key_name": "tempest-keypair-717718773", "user_data": "}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:50.250082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] validate_networks() for [('1d8166dc-91eb-4754-a625-1f72bd32d0b4', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:02:50.796405 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:02:50.797817 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:02:50.798476 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:02:50.799150 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:02:50.801081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:02:50.828029 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:50.829067 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:50.829664 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:50.831354 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:50.832035 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:50.832801 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:50.890540 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Getting quotas for project b32ff677e86d4be0b49869e579385a21. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:02:50.908516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Getting quotas for user 64e03bf24bb44add8adea800932e2f75 and project b32ff677e86d4be0b49869e579385a21. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:02:50.951058 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:02:50.957340 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:02:51.253369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6b55f6b3-bd3a-4c0f-be0d-892bb08b4fb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.509497 Oct 04 12:02:51.264585 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 4/9] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 5514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:02:51.273921 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5715a157-e441-4221-af65-66cda7611ba1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:51.275794 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5715a157-e441-4221-af65-66cda7611ba1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:51.449788 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5715a157-e441-4221-af65-66cda7611ba1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:51.485010 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5715a157-e441-4221-af65-66cda7611ba1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1215 microversion: 2.1 time: 0.215750 Oct 04 12:02:51.488059 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 5/10] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:51 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:52.534765 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-85cb35b7-fc8f-4282-930e-edbb2e497877 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:52.539207 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-85cb35b7-fc8f-4282-930e-edbb2e497877 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:52.725843 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-85cb35b7-fc8f-4282-930e-edbb2e497877 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:52.774168 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-85cb35b7-fc8f-4282-930e-edbb2e497877 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1215 microversion: 2.1 time: 0.242000 Oct 04 12:02:52.779165 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 6/11] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:52 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1215 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:53.507479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:02:53.512058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:02:53.512058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:02:53.517941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:02:53.522005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:02:53.552031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:53.556619 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:53.557434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:53.560698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:53.561521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:53.563186 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:53.634691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for project 4eb043e789a6467db5465a0107f41076. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:02:53.647046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for user fd040e13fd6c4b0dbea6a65932f84cb2 and project 4eb043e789a6467db5465a0107f41076. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:02:53.664317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:02:53.668045 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:02:53.807658 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-343de3fc-e81d-4e33-80bf-df808df28b32 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:53.808452 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-343de3fc-e81d-4e33-80bf-df808df28b32 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:53.901187 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-343de3fc-e81d-4e33-80bf-df808df28b32 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:53.910610 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-343de3fc-e81d-4e33-80bf-df808df28b32 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1215 microversion: 2.1 time: 0.109943 Oct 04 12:02:53.929144 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:53 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:53.938558 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-794839358", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a843603-1123-4e00-9b28-113fe25ca6eb"}], "security_groups": [{"name": "tempest-securitygroup--1552881456"}], "key_name": "tempest-keypair-887160329", "user_data": "}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:02:53.959902 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5a5a6bf1-3184-4670-929c-26a745a62d83 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.104352 Oct 04 12:02:53.961029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 6/13] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:02:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 4107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:02:54.014884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e47f9e4e-a463-4519-9f57-2ed9107cac45 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:54.026567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e47f9e4e-a463-4519-9f57-2ed9107cac45 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:54.086751 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] validate_networks() for [('6a843603-1123-4e00-9b28-113fe25ca6eb', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:02:54.272448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e47f9e4e-a463-4519-9f57-2ed9107cac45 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:54.327962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e47f9e4e-a463-4519-9f57-2ed9107cac45 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1235 microversion: 2.1 time: 0.348965 Oct 04 12:02:54.347783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 7/14] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:53 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1235 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:54.944149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-af1a1687-0699-4301-80dd-cc01f00af6bc tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:54.946747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-af1a1687-0699-4301-80dd-cc01f00af6bc tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:55.050653 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-af1a1687-0699-4301-80dd-cc01f00af6bc tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:55.066835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-af1a1687-0699-4301-80dd-cc01f00af6bc tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1215 microversion: 2.1 time: 0.132948 Oct 04 12:02:55.092212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:54 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:55.312503 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:02:55.314358 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:02:55.315912 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:02:55.317280 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:02:55.318731 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:02:55.359846 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:55.360472 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:55.362916 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:55.365246 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:55.366060 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:55.366899 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:55.391539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-deba8f7f-d95e-47a0-b20c-f3753b4d5d13 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:55.395136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-deba8f7f-d95e-47a0-b20c-f3753b4d5d13 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:55.399435 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:02:55.406860 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:02:55.427778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:02:55.432010 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:02:55.530690 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-deba8f7f-d95e-47a0-b20c-f3753b4d5d13 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:55.551100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-deba8f7f-d95e-47a0-b20c-f3753b4d5d13 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1235 microversion: 2.1 time: 0.186122 Oct 04 12:02:55.554272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:55 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1235 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:02:55.782879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-73b4b27a-265a-4767-96c6-629d861a74f2 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.850756 Oct 04 12:02:55.794783 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 8/17] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:02:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:02:55.812792 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8bf2febe-f701-4024-bc75-26483db0870d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:55.813765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8bf2febe-f701-4024-bc75-26483db0870d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:56.040373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8bf2febe-f701-4024-bc75-26483db0870d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:56.057312 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8bf2febe-f701-4024-bc75-26483db0870d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1240 microversion: 2.1 time: 0.250139 Oct 04 12:02:56.058836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:55 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1240 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:56.118184 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:56.119472 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:56.145870 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:56.149614 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:56.150454 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:56.156367 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:56.157264 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:56.158040 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:56.594289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c5aa5fbc-4cf5-41fe-a27c-89fb9a272017 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:56.611170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c5aa5fbc-4cf5-41fe-a27c-89fb9a272017 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:56.759028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c5aa5fbc-4cf5-41fe-a27c-89fb9a272017 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:56.775092 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c5aa5fbc-4cf5-41fe-a27c-89fb9a272017 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1235 microversion: 2.1 time: 0.199217 Oct 04 12:02:56.777136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 11/19] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:56 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1235 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:56.848803 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:56.887649 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-33f44829-cea0-4842-a125-0a28eaca2593 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1211 microversion: 2.1 time: 0.785032 Oct 04 12:02:56.891901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 9/20] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:56 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1211 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:57.139857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3e893fb8-c101-4ef0-acd4-543088e72881 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:57.139857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3e893fb8-c101-4ef0-acd4-543088e72881 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:57.228472 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3e893fb8-c101-4ef0-acd4-543088e72881 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:57.237455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3e893fb8-c101-4ef0-acd4-543088e72881 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1240 microversion: 2.1 time: 0.139007 Oct 04 12:02:57.240310 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 12/21] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:57 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1240 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:57.822066 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:57.822925 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:57.831849 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:57.833290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:57.834027 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:57.835362 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:57.836107 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:57.836858 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:57.938377 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:57.939255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:57.948395 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:57.958464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:57.960114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:57.961512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:57.963171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:57.964303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:57.964764 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-0e12908c-41c4-4d34-ad74-4504d755413b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1239 microversion: 2.1 time: 0.148128 Oct 04 12:02:57.965536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:57.966260 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 10/22] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:57 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1239 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:58.283559 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:58.284720 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:58.300933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:58.321701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:58.323193 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:58.324412 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:58.325745 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:58.326689 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:58.327579 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:58.373831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-83f2075d-0f81-4355-9fb4-ee90746e729f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1275 microversion: 2.1 time: 0.444141 Oct 04 12:02:58.380517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 13/23] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:57 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1275 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:58.581067 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:58.601056 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5abe701f-ecc6-4e6a-840b-84a3cd8268f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1244 microversion: 2.1 time: 0.323829 Oct 04 12:02:58.602491 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 11/24] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:58 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1244 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:02:59.032512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:59.032512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:59.046548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:59.047559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:59.049039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:59.051979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:59.052996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:59.053848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:59.296600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:59.319084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0461f564-c2bf-4981-998b-54e4d5792d3b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1287 microversion: 2.1 time: 0.313486 Oct 04 12:02:59.320096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:59 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1287 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:59.423229 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:59.423910 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:59.458464 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:59.459307 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:59.459951 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:59.461194 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:59.462024 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:59.462864 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:59.565068 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:02:59.580785 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-67b659fb-c2f9-4482-bcd0-bd75d744635b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1273 microversion: 2.1 time: 0.161444 Oct 04 12:02:59.581771 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 12/26] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:59 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:02:59.643854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:02:59.645061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:02:59.656944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:59.657826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:59.659443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:02:59.660899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:02:59.661748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:02:59.662520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:00.027559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:00.046587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bc3e0958-e571-41b9-b5d4-02bc4c910d87 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1292 microversion: 2.1 time: 0.410972 Oct 04 12:03:00.047744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 15/27] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:02:59 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1292 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:00.382690 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:00.384576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:00.445873 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:00.466412 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:00.466412 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:00.466412 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:00.468675 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:00.469377 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:00.622306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:00.623211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:00.648950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:00.649452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:00.655805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:00.656623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:00.657284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:00.657629 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:00.849003 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:00.865118 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-db93c6a2-05e0-489a-a842-b0144c4279fa tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1305 microversion: 2.1 time: 0.504624 Oct 04 12:03:00.867701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 13/28] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:00 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1305 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:01.087008 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:01.088359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:01.110570 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:01.113376 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:01.115433 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:01.119256 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:01.123841 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:01.124377 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:01.381623 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:01.414761 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-2c31b628-d500-405d-bf4e-110eb0945be9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1300 microversion: 2.1 time: 0.324865 Oct 04 12:03:01.414761 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 14/29] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:01 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1300 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:01.527798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:01.545806 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d10fba8e-9b51-4cea-979e-ddcb10eba8e9 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.927444 Oct 04 12:03:01.560894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 16/30] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:00 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:01.918979 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:01.925563 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:01.959836 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:01.962038 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:01.963322 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:01.964896 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:01.966414 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:01.967402 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:02.285007 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:02.319241 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-51d2b187-c1ba-4986-b03f-962542dee96b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1293 microversion: 2.1 time: 0.407267 Oct 04 12:03:02.360328 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 15/31] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:01 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1293 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:02.452844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:02.454326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:02.473448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:02.474484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:02.475244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:02.476679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:02.477664 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:02.478367 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:02.575812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:02.578874 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:02.595795 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:02.596675 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:02.597497 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:02.601288 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:02.602094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:02.610989 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:02.751652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:02.779229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ac653469-834d-4f98-b370-9ea68a85f0f1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1298 microversion: 2.1 time: 0.332001 Oct 04 12:03:02.781793 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:02 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1298 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:03.378645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:03.378645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:03.393980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:03.394713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:03.395210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:03.401147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:03.405715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:03.406920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:03.511286 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:03.524568 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-fc34adef-cfe5-42cf-98ec-2ae860c9c8ee tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.956033 Oct 04 12:03:03.543792 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 16/33] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:02 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:03.612839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:03.814803 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:03.822192 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:03.823636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:03.857657 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3fc93b58-49e3-437e-98c7-189a3593f51a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1293 microversion: 2.1 time: 0.487031 Oct 04 12:03:03.859609 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:03.866016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 18/34] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:03 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1293 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:03.881263 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:03.882286 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:03.883514 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:03.884577 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:03.885416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:04.123212 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:04.144483 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6fad9f5f-6b81-4b62-a747-488cc5bf47c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1298 microversion: 2.1 time: 0.336761 Oct 04 12:03:04.146204 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 17/35] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:03 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1298 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:04.573906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:04.576041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:04.601661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:04.603114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:04.604197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:04.605838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:04.606941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:04.608387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:04.893574 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:04.922142 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:04.971943 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:04.984594 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:04.986059 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:04.987640 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:05.000557 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:05.005857 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:05.380638 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=4 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:05.422131 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=18 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:05.616554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:05.649222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-3c9e6480-f26c-4034-9f95-c02fe57ebf89 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.764091 Oct 04 12:03:05.653025 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 18/36] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:04 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:05.673134 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:05.679053 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:05.700380 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:05.701237 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:05.701962 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:05.703194 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:05.704218 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:05.710456 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.022697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:06.078735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9127011b-c296-4442-bff2-e0e228ca91f5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 1.527187 Oct 04 12:03:06.092945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 19/37] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:04 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:06.552786 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:06.572414 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f6aa712b-9ebb-4cf7-ad67-a75bc8bacdd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.917580 Oct 04 12:03:06.585388 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:05 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:06.706226 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:06.708034 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:06.736684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-e44fdd19-3595-4b79-8117-867945e3f87c req-5f5b99af-8859-4745-9b62-d94e4c45a4fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f12703-3e0e-4cad-ab29-1366fe553810", "tag": "81665b9a-98a8-480e-a9bd-73d4e8a6b78a"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:06.765143 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:06.766810 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:06.766810 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.767079 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:06.767367 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:06.767966 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.798809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e44fdd19-3595-4b79-8117-867945e3f87c req-5f5b99af-8859-4745-9b62-d94e4c45a4fc service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:06.799621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e44fdd19-3595-4b79-8117-867945e3f87c req-5f5b99af-8859-4745-9b62-d94e4c45a4fc service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:06.810248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e44fdd19-3595-4b79-8117-867945e3f87c req-5f5b99af-8859-4745-9b62-d94e4c45a4fc service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.896119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-e44fdd19-3595-4b79-8117-867945e3f87c req-5f5b99af-8859-4745-9b62-d94e4c45a4fc service nova] Creating event network-changed:81665b9a-98a8-480e-a9bd-73d4e8a6b78a for instance 34f12703-3e0e-4cad-ab29-1366fe553810 on hv-cinder-86021 Oct 04 12:03:06.896714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e44fdd19-3595-4b79-8117-867945e3f87c req-5f5b99af-8859-4745-9b62-d94e4c45a4fc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133083) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 12:03:06.897457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e44fdd19-3595-4b79-8117-867945e3f87c req-5f5b99af-8859-4745-9b62-d94e4c45a4fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=133083) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 12:03:06.903575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:06.909171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:06.909972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.911957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:06.912906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:06.913678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:06.979012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.compute.rpcapi [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 12:03:06.980699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] Releasing lock "compute-rpcapi-router" {{(pid=133083) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 12:03:07.044465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-109b5304-a953-4fca-9d8e-3f2158408c97 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452044 Oct 04 12:03:07.046153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 20/39] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:07.130359 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:07.131517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:07.143859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:07.149722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:07.150487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:07.153024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:07.155658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:07.157633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:07.233763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=26 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:07.267457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:07.283504 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e3d2938e-5626-4f20-a878-7f2bbefbee1f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.585367 Oct 04 12:03:07.284849 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:06 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:07.599763 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:07.601302 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:07.616347 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:07.617097 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:07.617696 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:07.618584 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:07.619451 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:07.620039 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:07.935512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:07.946084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a0ba86d0-e617-4eb2-8a1b-583523c75dac tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.821587 Oct 04 12:03:07.947062 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 21/41] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:07 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:08.016879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:08.031657 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f8c27d15-946b-4590-b594-aa8407982886 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.437009 Oct 04 12:03:08.033052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:07 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:08.349270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:08.350528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:08.395909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:08.397318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:08.403204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:08.403204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:08.403204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:08.405251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:08.886380 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-d4a5cfc7-c0ba-4bd6-bfff-ed62ebe95f43 req-6f54bde5-81cb-4e8f-860b-69686fbfbff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b", "tag": "39184605-6fa0-4bf3-b70f-59aac0ab9b51"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:08.939938 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-d4a5cfc7-c0ba-4bd6-bfff-ed62ebe95f43 req-6f54bde5-81cb-4e8f-860b-69686fbfbff0 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:08.941384 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-d4a5cfc7-c0ba-4bd6-bfff-ed62ebe95f43 req-6f54bde5-81cb-4e8f-860b-69686fbfbff0 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:08.942488 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-d4a5cfc7-c0ba-4bd6-bfff-ed62ebe95f43 req-6f54bde5-81cb-4e8f-860b-69686fbfbff0 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:08.977200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:08.989981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-d4a5cfc7-c0ba-4bd6-bfff-ed62ebe95f43 req-6f54bde5-81cb-4e8f-860b-69686fbfbff0 service nova] Creating event network-changed:39184605-6fa0-4bf3-b70f-59aac0ab9b51 for instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b on hv-cinder-86021 Oct 04 12:03:08.990714 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-d4a5cfc7-c0ba-4bd6-bfff-ed62ebe95f43 req-6f54bde5-81cb-4e8f-860b-69686fbfbff0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 12:03:08.991334 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-d4a5cfc7-c0ba-4bd6-bfff-ed62ebe95f43 req-6f54bde5-81cb-4e8f-860b-69686fbfbff0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=133084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 12:03:08.992737 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:08.993302 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:08.993821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e300fd6c-cf74-45df-8ddb-97c92fcb252a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.662772 Oct 04 12:03:08.993988 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:08.994708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:08 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:08.995003 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:08.995580 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:08.996250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:08.999746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:09.000467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:09.011088 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.011309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.011631 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.012414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.012870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.013296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.015936 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.compute.rpcapi [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 12:03:09.017605 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] Releasing lock "compute-rpcapi-router" {{(pid=133084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 12:03:09.044523 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-c1b07908-37d5-44d3-b369-f9d21932a89a None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389478 Oct 04 12:03:09.046398 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 22/44] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:03:09.080986 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:09.083417 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:09.099927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.099927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.101819 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.104415 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.105873 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.107095 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.409528 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:09.441322 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f41430d4-6fd0-4498-91dc-e4615c2db56f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.375528 Oct 04 12:03:09.442751 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 23/45] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:09 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:09.469253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-da8f8ea3-1136-4fb5-8e63-2b6673f279da req-7ae91974-da4e-4095-b436-9f647e514328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889c6e11-6374-4ec0-aacc-addc853c945d", "tag": "b1974f78-ed23-4d93-990a-dc57aca745ee"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:09.503519 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-da8f8ea3-1136-4fb5-8e63-2b6673f279da req-7ae91974-da4e-4095-b436-9f647e514328 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:09.504643 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-da8f8ea3-1136-4fb5-8e63-2b6673f279da req-7ae91974-da4e-4095-b436-9f647e514328 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:09.505522 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-da8f8ea3-1136-4fb5-8e63-2b6673f279da req-7ae91974-da4e-4095-b436-9f647e514328 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:09.537548 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-da8f8ea3-1136-4fb5-8e63-2b6673f279da req-7ae91974-da4e-4095-b436-9f647e514328 service nova] Creating event network-changed:b1974f78-ed23-4d93-990a-dc57aca745ee for instance 889c6e11-6374-4ec0-aacc-addc853c945d on hv-cinder-86021 Oct 04 12:03:09.561205 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-da8f8ea3-1136-4fb5-8e63-2b6673f279da req-7ae91974-da4e-4095-b436-9f647e514328 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086863 Oct 04 12:03:09.572120 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 24/46] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:03:09.631700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:09.662242 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-06670067-424d-47c3-abaf-c44d00774dab tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.666338 Oct 04 12:03:09.663343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 23/47] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:08 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:10.053775 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:10.056517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:10.076295 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.077289 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.079584 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.084207 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.090940 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.091800 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.434603 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:10.451429 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=100 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:10.474848 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b30e60d7-1bf5-4cbc-bc54-db86ee1f5b9a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.436277 Oct 04 12:03:10.480094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:10 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:10.486086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:10.487557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:10.510560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.511817 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.513890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.517493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.518162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.518761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.692128 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:10.693214 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:10.714866 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.715817 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.716776 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.718121 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:10.718978 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:10.728713 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:10.836490 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:10.873145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ecdfcb2e-709e-4ffa-8386-b7a7d1011621 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.392478 Oct 04 12:03:10.896543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 24/49] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:10 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:11.117666 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:11.157115 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d2bd2959-e93e-4db7-bfb4-05dd8e2d18b8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.472668 Oct 04 12:03:11.159418 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 26/50] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:10 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:11.528737 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:11.529800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:11.541488 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:11.542364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:11.543175 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:11.544557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:11.570768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:11.574118 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:11.917875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:11.926653 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3d5e0c72-7ae5-4d16-a324-547587c0187d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.403768 Oct 04 12:03:11.937927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:11.939880 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:11.944644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 25/51] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:11 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:11.959629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:11.961413 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:11.962576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:11.966398 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:11.967722 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:11.969072 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:12.187964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:12.188945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:12.213564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:12.220244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:12.224358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:12.225602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:12.226107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:12.226549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:12.950862 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:12.989780 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-414c65ef-6697-45cf-97ee-cbd89c74ef64 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 1.064460 Oct 04 12:03:12.993597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 27/52] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:11 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:13.017136 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:13.019225 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:13.039238 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:13.041262 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:13.043985 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:13.047842 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:13.049540 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:13.050923 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:13.385877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:13.401602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fb816af1-cb47-4058-ab34-6cda9fa600e8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 1.219993 Oct 04 12:03:13.417842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 26/53] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:12 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:14.034859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:14.036434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:14.046254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:14.049387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:14.050196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:14.058196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:14.058196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:14.058196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:14.058196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:14.090375 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:14.120809 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-17e47baa-d5f0-4e0a-90e0-5a6b9309eac5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 1.124074 Oct 04 12:03:14.139875 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 28/54] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:12 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:14.443745 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:14.444450 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:14.462450 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:14.463019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:14.463461 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:14.468853 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:14.469347 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:14.473314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:15.114402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:15.129979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-911b42e1-415c-4d3b-9a5c-0efc93d71da5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 1.098489 Oct 04 12:03:15.144925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 27/55] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:14 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:15.176879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:15.177689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:15.185690 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:15.187093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:15.187760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:15.188874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:15.189337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:15.189822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:15.264929 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:15.286346 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d70d83dc-6de5-47a2-b9a8-e915e45a0bb3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.846538 Oct 04 12:03:15.288070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 29/56] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:14 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:15.793240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:15.811883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bf543b68-b42e-49d4-b892-60107be580ca tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.641434 Oct 04 12:03:15.822147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 28/57] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:15 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:16.164547 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:16.164547 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:16.164547 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:16.181033 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:16.181892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:16.184327 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:16.190957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:16.192434 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:16.192949 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:16.313009 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:16.313632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:16.320747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:16.321245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:16.321714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:16.322448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:16.323171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:16.323643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:16.347836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:16.382708 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:16.393016 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-07baedf0-5045-4890-90f8-34e7ffdc78b5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.241245 Oct 04 12:03:16.393843 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 30/58] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:16 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:16.545218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:16.559048 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-40d54f99-faf2-46d4-a321-ce1e061b11c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.250199 Oct 04 12:03:16.560107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:16 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:16.840292 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:16.842049 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:16.852629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:16.853815 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:16.854462 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:16.855770 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:16.856648 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:16.857356 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:17.013797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:17.022485 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f8077f85-41b2-4cad-9392-977a174dd395 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.188592 Oct 04 12:03:17.023115 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 31/60] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:16 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:17.440393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:17.441268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:17.444775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:17.450705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:17.451196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:17.451628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:17.452512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:17.452877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:17.453304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:17.599314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:17.609421 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:17.609421 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:17.609421 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:17.609421 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:17.610020 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:17.610020 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:17.610277 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:17.671336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:17.680313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4c4efb60-5430-4524-a722-605a66b9cc0e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.248466 Oct 04 12:03:17.680940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 30/61] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:17 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:17.774315 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:17.786153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-423eaf72-ad3d-4201-b665-a16170abdee3 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.192029 Oct 04 12:03:17.789908 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 32/62] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:17 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:18.068749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:18.070491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:18.085413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:18.086841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:18.087825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:18.089267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:18.091293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:18.092215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:18.320112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:18.332272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f1bd4a56-b82f-4f10-8137-6601e9140e08 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.276120 Oct 04 12:03:18.333336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:18 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:18.709066 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:18.710881 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:18.724469 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:18.726263 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:18.727848 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:18.736790 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:18.739010 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:18.740122 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:18.810669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:18.811293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:18.820660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:18.821451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:18.821893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:18.822613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:18.823064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:18.823486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:19.012507 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=2 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:19.017230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:19.020843 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:19.027752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-57358234-cfe6-4ce3-ba45-70b3c1f7040a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.222367 Oct 04 12:03:19.043425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:18 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:19.043589 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f8ef8bd0-ee7f-488a-99d8-c96e3d3b12a1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.340442 Oct 04 12:03:19.044415 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:18 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:19.358506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:19.359000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:19.366712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:19.367487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:19.368190 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:19.369112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:19.369761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:19.370344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:19.645389 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:19.650950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b5b38b79-d5d3-4167-b957-24b7ce23e5d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.297528 Oct 04 12:03:19.651554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 33/66] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:19 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:20.093225 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:20.129156 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:20.130001 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:20.130386 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:20.130386 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:20.130386 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:20.130386 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:20.130849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:20.130930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:20.130930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:20.130930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:20.132631 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:20.134444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:20.135406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:20.137732 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:20.140599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:20.377342 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:20.378365 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:20.390489 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-8c65df51-3a22-4c9c-b4bd-9f06a838bafb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.321954 Oct 04 12:03:20.391413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8110d514-45ae-4288-b8c7-344b338827c8 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.319888 Oct 04 12:03:20.391583 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 34/67] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:20 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:20.392153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:20 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:20.675407 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:20.676604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:20.683180 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:20.683669 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:20.684103 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:20.684859 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:20.685324 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:20.685740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:20.840592 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:20.855605 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-ab91b6db-d3e6-4597-94c2-7e3c827a600d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.183646 Oct 04 12:03:20.856592 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 35/69] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:20 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:21.419076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:21.421021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:21.429198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:21.430037 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:21.430186 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:21.430326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:21.430657 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:21.431556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:21.432106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:21.432643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:21.436920 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:21.437497 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:21.438046 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:21.438879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:21.439423 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:21.439961 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:21.594614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:21.609821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e4b74ade-e858-4a76-8401-d3594b62d96a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.196101 Oct 04 12:03:21.611144 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 35/70] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:21 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:21.637151 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:21.648645 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-219f1a43-334d-4c5d-a862-af7598c26a20 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.224582 Oct 04 12:03:21.649329 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 36/71] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:21 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:21.892518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:21.893551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:21.901517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:21.902166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:21.902713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:21.903636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:21.904277 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:21.904949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:22.158509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:22.188978 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b8f8cb09-1ee9-41c7-ae70-61c3654cacc9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.300606 Oct 04 12:03:22.190067 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 36/72] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:21 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:22.637615 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:22.640309 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:22.661130 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:22.662262 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:22.663690 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:22.665906 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:22.667692 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:22.669832 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:22.675155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:22.676506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:22.688194 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:22.689026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:22.690848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:22.695532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:22.696018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:22.696636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:22.933434 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:22.948838 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b540fad7-7bc8-4875-966d-78ce8a14a356 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.317301 Oct 04 12:03:22.949635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:22.950114 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 37/73] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:22 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:22.974125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d2369782-a3a7-4cb3-86bf-ba69290232fa tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.303046 Oct 04 12:03:22.975403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 37/74] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:22 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:23.219314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:23.219934 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:23.227081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:23.227965 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:23.228575 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:23.229627 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:23.230364 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:23.231025 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:23.496430 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:23.511703 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9b272471-b296-43e7-a5ec-4130dd47ed3a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.296058 Oct 04 12:03:23.513462 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 38/75] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:23 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:23.817361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-88e4d97e-ab2c-4194-8456-53d1c0b45d0a req-fb57d281-0388-460e-b8e8-bb97a487a854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f12703-3e0e-4cad-ab29-1366fe553810", "name": "network-vif-plugged", "status": "completed", "tag": "81665b9a-98a8-480e-a9bd-73d4e8a6b78a"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:23.858290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-88e4d97e-ab2c-4194-8456-53d1c0b45d0a req-fb57d281-0388-460e-b8e8-bb97a487a854 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:23.859841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-88e4d97e-ab2c-4194-8456-53d1c0b45d0a req-fb57d281-0388-460e-b8e8-bb97a487a854 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:23.860988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-88e4d97e-ab2c-4194-8456-53d1c0b45d0a req-fb57d281-0388-460e-b8e8-bb97a487a854 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:23.889085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-88e4d97e-ab2c-4194-8456-53d1c0b45d0a req-fb57d281-0388-460e-b8e8-bb97a487a854 service nova] Creating event network-vif-plugged:81665b9a-98a8-480e-a9bd-73d4e8a6b78a for instance 34f12703-3e0e-4cad-ab29-1366fe553810 on hv-cinder-86021 Oct 04 12:03:23.902120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-88e4d97e-ab2c-4194-8456-53d1c0b45d0a req-fb57d281-0388-460e-b8e8-bb97a487a854 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.352585 Oct 04 12:03:23.904450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 38/76] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:23.987239 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:23.988898 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:23.999835 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.000736 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.001491 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:24.002396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:24.003863 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:24.022102 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.023052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.023756 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:24.024212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.025282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.026419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:24.027726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.028605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.029328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:24.327988 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:24.342693 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-19b6b92c-3288-4a9f-943e-392981e04bc8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.371762 Oct 04 12:03:24.342835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:24.360510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4e669099-d00b-4b19-8ec3-77a0720a421f tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.363680 Oct 04 12:03:24.372211 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 39/77] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:23 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:24.373015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 39/78] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:23 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:24.540844 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:24.541477 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:24.548209 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.548889 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.549321 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:24.550981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:24.551641 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:24.552267 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:24.811997 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:24.823473 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5af627f6-da06-4dd3-9467-4993ede5240d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.288399 Oct 04 12:03:24.824734 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 40/79] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:24 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:25.387273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:25.388467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:25.399387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.400308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.401045 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.401856 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:25.402363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.402499 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:25.403123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.403905 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.411649 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.412416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.414725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.414725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.414725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.415106 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.615072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:25.624078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-03572004-1232-4839-9db8-230b0a96db05 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.244011 Oct 04 12:03:25.624976 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 40/80] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:25 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:25.690769 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:25.702880 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-7c2a1975-1549-463c-b98f-659868e63057 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.305319 Oct 04 12:03:25.703466 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 41/81] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:25 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:25.848427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:25.849055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:25.855439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.855933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.856429 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.857139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.857691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.858021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.935534 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-95d28068-99c4-47c2-b4f1-6071e64f3ee5 req-7dd6dde6-c93d-4b9a-bfb3-71840e098ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b", "name": "network-vif-plugged", "status": "completed", "tag": "39184605-6fa0-4bf3-b70f-59aac0ab9b51"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:25.958025 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-95d28068-99c4-47c2-b4f1-6071e64f3ee5 req-7dd6dde6-c93d-4b9a-bfb3-71840e098ce7 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:25.959808 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-95d28068-99c4-47c2-b4f1-6071e64f3ee5 req-7dd6dde6-c93d-4b9a-bfb3-71840e098ce7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:25.960953 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-95d28068-99c4-47c2-b4f1-6071e64f3ee5 req-7dd6dde6-c93d-4b9a-bfb3-71840e098ce7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:25.988859 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-95d28068-99c4-47c2-b4f1-6071e64f3ee5 req-7dd6dde6-c93d-4b9a-bfb3-71840e098ce7 service nova] Creating event network-vif-plugged:39184605-6fa0-4bf3-b70f-59aac0ab9b51 for instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b on hv-cinder-86021 Oct 04 12:03:26.012569 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-95d28068-99c4-47c2-b4f1-6071e64f3ee5 req-7dd6dde6-c93d-4b9a-bfb3-71840e098ce7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091785 Oct 04 12:03:26.014088 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 42/82] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:03:26.111707 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:26.148712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b479a213-4b69-4896-ba5f-82ff37a0c08f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.290858 Oct 04 12:03:26.148712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 41/83] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:25 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:26.649306 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:26.650086 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:26.657325 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:26.658060 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:26.658736 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:26.660920 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:26.661604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:26.662031 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:26.667288 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=100 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:26.732074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:26.734535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:26.746651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:26.747808 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:26.748586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:26.749805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:26.750998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:26.751938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:26.915966 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:26.932161 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-12609fdc-2227-41f1-8430-47fd61ae0081 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.287133 Oct 04 12:03:26.935245 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 43/84] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:26 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:27.037791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:27.050803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ac5bc376-24f3-4840-bace-bc94aee6bf54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1315 microversion: 2.1 time: 0.326409 Oct 04 12:03:27.061801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:26 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:27.181471 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:27.182425 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:27.189275 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:27.190125 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:27.191054 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:27.192028 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:27.192647 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:27.193012 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:27.345410 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:27.360556 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-cb010b76-3b5f-47d1-869c-ff3dac543386 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.183234 Oct 04 12:03:27.361571 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 44/86] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:27 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:27.962433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:27.963941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:27.974177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:27.974914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:27.975604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:27.976700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:27.977494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:27.978254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.047666 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-075214e0-46f7-49ca-81ad-8bc58caccde7 req-824c5540-8b09-476e-a95d-d202c26864f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889c6e11-6374-4ec0-aacc-addc853c945d", "name": "network-vif-plugged", "status": "completed", "tag": "b1974f78-ed23-4d93-990a-dc57aca745ee"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:28.070759 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-075214e0-46f7-49ca-81ad-8bc58caccde7 req-824c5540-8b09-476e-a95d-d202c26864f8 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:28.070759 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-075214e0-46f7-49ca-81ad-8bc58caccde7 req-824c5540-8b09-476e-a95d-d202c26864f8 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:28.070759 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-075214e0-46f7-49ca-81ad-8bc58caccde7 req-824c5540-8b09-476e-a95d-d202c26864f8 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.088519 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-075214e0-46f7-49ca-81ad-8bc58caccde7 req-824c5540-8b09-476e-a95d-d202c26864f8 service nova] Creating event network-vif-plugged:b1974f78-ed23-4d93-990a-dc57aca745ee for instance 889c6e11-6374-4ec0-aacc-addc853c945d on hv-cinder-86021 Oct 04 12:03:28.097065 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-075214e0-46f7-49ca-81ad-8bc58caccde7 req-824c5540-8b09-476e-a95d-d202c26864f8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055485 Oct 04 12:03:28.098457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 45/87] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:28.108913 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:28.109967 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:28.118796 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:28.119536 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:28.120231 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.121450 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:28.122486 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:28.123278 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.212350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:28.222553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8f736b6a-d353-402a-88a3-8165e6600245 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.269242 Oct 04 12:03:28.223486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 43/88] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:27 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:28.312094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:28.321384 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-1aaf098a-4422-4e68-8af0-97af5ec8604a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1502 microversion: 2.1 time: 0.220309 Oct 04 12:03:28.322132 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 46/89] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:28 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:28.398791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:28.399427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:28.406072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:28.406835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:28.407452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.408203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:28.408815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:28.409492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:28.577344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:28.585793 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5a2bb484-6b91-41ac-be4a-fecafad5f847 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.192249 Oct 04 12:03:28.586372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 44/90] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:28 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:29.251392 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:29.252561 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:29.265378 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:29.266385 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:29.267628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:29.269698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:29.270772 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:29.271699 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:29.441231 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:29.449553 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6686dab4-7787-49fa-b91f-25402c7c5401 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.205832 Oct 04 12:03:29.455971 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 47/91] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:29 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:29.612917 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:29.614406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:29.627236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:29.629457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:29.630647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:29.632277 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:29.633476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:29.634585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:29.900568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:29.916143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9a243528-5ca9-4094-8ad5-d62bfa5288bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.309577 Oct 04 12:03:29.917837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 45/92] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:29 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:30.477352 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:30.478621 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:30.485375 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.486101 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.486852 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:30.489993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.490528 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.491181 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:30.680140 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:30.697401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-3f91adf5-9bfb-4079-aa0b-c917b1adea46 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.226807 Oct 04 12:03:30.697880 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 48/93] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:30 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:30.959688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:30.960740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:30.970953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.972931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.973935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:30.975291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:30.976593 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:30.977533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:31.146067 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:31.162666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:31.180123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4e7df898-58f8-479c-b16d-398a519ac800 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.227671 Oct 04 12:03:31.181218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 46/94] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:30 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:31.723442 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:31.725444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:31.732472 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:31.733166 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:31.733718 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:31.734549 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:31.735090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:31.735650 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:31.938057 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:31.947815 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-727aff13-0ee1-4f0b-92b1-02fa080778be tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1366 microversion: 2.1 time: 0.229795 Oct 04 12:03:31.957090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 49/95] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:31 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:32.001021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7663a1d-098a-4fc1-8ca3-4b6f51dd4f87"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:32.006554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:32.026391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:32.026391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:32.026391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:32.026900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:32.028424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:32.029241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:32.205368 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:32.206755 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:32.216015 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:32.216847 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:32.217307 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:32.218048 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:32.218514 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:32.219016 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:32.406885 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:32.417538 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-c7c33382-e4d3-4ede-83f0-84e6650241d9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.216313 Oct 04 12:03:32.418234 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 50/96] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:32 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:32.996509 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:32.996509 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:33.010004 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.010824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.011678 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:33.012657 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.013396 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.014344 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:33.235009 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:33.245133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-0551bb5a-5fe5-40b8-8491-c05a7e165500 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1555 microversion: 2.1 time: 0.258187 Oct 04 12:03:33.245754 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 51/97] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:32 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1555 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:33.271902 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:33.272888 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:33.281334 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.281825 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.284872 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:33.284872 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.284872 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.284872 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:33.455316 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-7ed114c5-119f-444f-8159-ce80b187bda4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188936 Oct 04 12:03:33.456535 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 52/98] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:03:33 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:03:33.497891 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:33.501701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:33.522335 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.524427 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.532988 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:33.535438 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:33.536471 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:33.537655 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:34.137853 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:34.149560 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-76cc8171-4e65-4fee-bba5-155dd15b4820 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1361 microversion: 2.1 time: 0.690989 Oct 04 12:03:34.150498 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 53/99] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:33 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1361 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:34.742428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c034a1a6-e73e-4bad-9d65-ee9d9cb7aa55 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "POST /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.750205 Oct 04 12:03:34.744305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 47/100] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:03:31 2022] POST /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810/os-volume_attachments => generated 194 bytes in 2755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:35.202988 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:35.205678 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:35.218847 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:35.220193 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:35.222321 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:35.224861 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:35.226345 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:35.227427 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:35.540531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:35.550292 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-8e4f8c8d-77ef-4f51-8c69-ad36f1651122 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1547 microversion: 2.1 time: 0.356079 Oct 04 12:03:35.550963 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 54/101] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:35 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1547 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:35.584339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:35.585924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:35.598540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:35.599875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:35.600971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:35.606679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:35.606679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:35.606679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:35.754862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-77cb6800-7f5b-487b-bbde-62e4ed567891 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179894 Oct 04 12:03:35.758752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 48/102] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:03:35 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:35.910230 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-4bccb75e-e73a-429b-8c7d-372c5c332083 req-891a7406-95ec-4813-98a9-dfc416431d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b", "tag": "39184605-6fa0-4bf3-b70f-59aac0ab9b51"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:35.943198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4bccb75e-e73a-429b-8c7d-372c5c332083 req-891a7406-95ec-4813-98a9-dfc416431d83 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:35.944599 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4bccb75e-e73a-429b-8c7d-372c5c332083 req-891a7406-95ec-4813-98a9-dfc416431d83 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:35.945769 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4bccb75e-e73a-429b-8c7d-372c5c332083 req-891a7406-95ec-4813-98a9-dfc416431d83 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:35.978589 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-4bccb75e-e73a-429b-8c7d-372c5c332083 req-891a7406-95ec-4813-98a9-dfc416431d83 service nova] Creating event network-changed:39184605-6fa0-4bf3-b70f-59aac0ab9b51 for instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b on hv-cinder-86021 Oct 04 12:03:35.995250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-4bccb75e-e73a-429b-8c7d-372c5c332083 req-891a7406-95ec-4813-98a9-dfc416431d83 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087318 Oct 04 12:03:35.995250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 55/103] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:38.194005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-fb827e9a-6381-4d98-9f01-50826030b03e req-342c2617-953c-4257-9894-08b9856505c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889c6e11-6374-4ec0-aacc-addc853c945d", "tag": "b1974f78-ed23-4d93-990a-dc57aca745ee"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:38.257428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-fb827e9a-6381-4d98-9f01-50826030b03e req-342c2617-953c-4257-9894-08b9856505c1 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:38.257919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-fb827e9a-6381-4d98-9f01-50826030b03e req-342c2617-953c-4257-9894-08b9856505c1 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:38.258370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-fb827e9a-6381-4d98-9f01-50826030b03e req-342c2617-953c-4257-9894-08b9856505c1 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:38.288757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-fb827e9a-6381-4d98-9f01-50826030b03e req-342c2617-953c-4257-9894-08b9856505c1 service nova] Creating event network-changed:b1974f78-ed23-4d93-990a-dc57aca745ee for instance 889c6e11-6374-4ec0-aacc-addc853c945d on hv-cinder-86021 Oct 04 12:03:38.309553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-fb827e9a-6381-4d98-9f01-50826030b03e req-342c2617-953c-4257-9894-08b9856505c1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125476 Oct 04 12:03:38.310805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 49/104] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:03:49.988909 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=51 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:49.990598 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=66 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:49.999282 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:50.000604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:50.016504 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.017366 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.018270 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.019566 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.020453 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.021263 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.071889 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Going to try to terminate instance {{(pid=133084) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:03:50.583884 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-48e4f8ca-8801-4ee6-83e5-70ebd2513a48 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "DELETE /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 204 len: 0 microversion: 2.1 time: 0.596613 Oct 04 12:03:50.598707 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 56/105] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:03:49 2022] DELETE /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:03:50.618085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:50.622714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:50.644734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=45 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:50.645682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:03:50.648233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.649008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.649454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.650192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:50.650655 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:50.651085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:50.838566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:50.860097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7a0fefc4-0b7c-484d-b3a8-3f00bdf31a62 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1554 microversion: 2.1 time: 0.252566 Oct 04 12:03:50.861464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 50/106] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:50 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:51.909140 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:51.909943 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:51.918370 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:51.919001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:51.919762 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:51.920574 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:51.921144 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:51.921728 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:52.095028 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:52.111269 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d4388d5e-0337-4a75-94b8-60e730f9ccef tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1554 microversion: 2.1 time: 0.207702 Oct 04 12:03:52.112833 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 57/107] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:51 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:53.139042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:53.139733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:53.149060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:53.149522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:53.150127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:53.150859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:53.151318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:53.151748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:53.307253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:53.322303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-df7cdbe7-a654-4673-bb31-e6420efeef5a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1554 microversion: 2.1 time: 0.188598 Oct 04 12:03:53.323729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 51/108] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:53 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:54.234925 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-f51809ab-df9d-4059-93b2-f169e0c053a9 req-e1df2775-12a1-458a-9da2-970d1b6e9c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f12703-3e0e-4cad-ab29-1366fe553810", "name": "network-vif-deleted", "tag": "81665b9a-98a8-480e-a9bd-73d4e8a6b78a"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:03:54.253795 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f51809ab-df9d-4059-93b2-f169e0c053a9 req-e1df2775-12a1-458a-9da2-970d1b6e9c7f service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:54.254319 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f51809ab-df9d-4059-93b2-f169e0c053a9 req-e1df2775-12a1-458a-9da2-970d1b6e9c7f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:54.254879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f51809ab-df9d-4059-93b2-f169e0c053a9 req-e1df2775-12a1-458a-9da2-970d1b6e9c7f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:54.274849 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-f51809ab-df9d-4059-93b2-f169e0c053a9 req-e1df2775-12a1-458a-9da2-970d1b6e9c7f service nova] Creating event network-vif-deleted:81665b9a-98a8-480e-a9bd-73d4e8a6b78a for instance 34f12703-3e0e-4cad-ab29-1366fe553810 on hv-cinder-86021 Oct 04 12:03:54.283276 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-f51809ab-df9d-4059-93b2-f169e0c053a9 req-e1df2775-12a1-458a-9da2-970d1b6e9c7f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055681 Oct 04 12:03:54.284840 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 58/109] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:03:54.351208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:54.352248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:54.366578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:54.367454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:54.368677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:54.370437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:54.371802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:54.372625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:54.452995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:54.468509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b5421583-7375-423a-81c2-5ff880531d54 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1512 microversion: 2.1 time: 0.122701 Oct 04 12:03:54.469600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 52/110] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:54 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1512 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:03:55.504332 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:55.505175 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:55.511993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:55.516742 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:55.516742 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:55.516742 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:55.516742 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:55.517413 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:55.551351 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:55.551840 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:55.552320 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:55.552787 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.objects.instance [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lazy-loading 'fault' on Instance uuid 34f12703-3e0e-4cad-ab29-1366fe553810 {{(pid=133084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:03:55.618971 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:55.631460 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-7122c91e-23f1-4df2-94d5-f8739293039a tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1351 microversion: 2.1 time: 0.132676 Oct 04 12:03:55.632477 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 59/111] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:55 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:56.670167 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:56.672162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:56.686227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:56.686227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:56.686561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:56.687643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:56.688510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:56.689754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:56.745296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:56.746012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:56.750039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:56.750039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lazy-loading 'fault' on Instance uuid 34f12703-3e0e-4cad-ab29-1366fe553810 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:03:56.800965 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:56.816145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-13c23a59-c906-4316-8aa4-87a2e927f7c0 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1351 microversion: 2.1 time: 0.150014 Oct 04 12:03:56.817116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 53/112] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:56 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1351 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:57.855222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:57.856074 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:57.864460 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:57.864766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:57.865260 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:57.866408 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:57.867055 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:57.867484 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:57.904408 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:57.904807 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:57.905239 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:57.905690 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.objects.instance [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lazy-loading 'fault' on Instance uuid 34f12703-3e0e-4cad-ab29-1366fe553810 {{(pid=133084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:03:57.953283 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:57.963392 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-39aa1584-bec9-4c08-a1c9-4cdee381e2e5 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1351 microversion: 2.1 time: 0.112012 Oct 04 12:03:57.964006 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 60/113] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:57 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:03:59.011418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:03:59.012888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:03:59.025291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:59.026161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:59.026953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:59.028218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:59.029335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:59.030217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:59.104121 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:03:59.105406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:03:59.106132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:03:59.107099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lazy-loading 'fault' on Instance uuid 34f12703-3e0e-4cad-ab29-1366fe553810 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:03:59.181553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e03bf24bb44add8adea800932e2f75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32ff677e86d4be0b49869e579385a21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:03:59.198257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-12081918-9874-4a82-983f-08c2d90c73d1 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 200 len: 1351 microversion: 2.1 time: 0.199075 Oct 04 12:03:59.199469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 54/114] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:03:58 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 1351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:00.236716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:00.238056 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:00.259748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:00.259748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:00.259748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:00.259748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:00.260381 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:00.260381 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:00.277206 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.wsgi [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] HTTP exception thrown: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Request method failure captured: Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: request: GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 HTTP/1.1 Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept: application/json Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept-Encoding: identity Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Connection: close Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Length: 0 Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Type: application/json Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Host: 10.222.0.15 Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Openstack-System-Scope: None Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Auth-Token: gAAAAABjPCDkYjOyp7jPI5zy0jR8LGcLYSW3KksboclL7eZHFImPuKsOriacdVFm6azElpCMjGRkCKJ-DpYIntKLuNqV64LS2vt9TPxAcpDtdpT_GizcWkcN7sJePY-7CpYxlr4TjrkvhiU9u8iQI3lx06D4Iu2g1o2W4L52Vy05Xrn7Cxs7GOY Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Id: None Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Name: None Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Identity-Status: Confirmed Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Is-Admin-Project: True Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Id: default Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Name: Default Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Role: reader,member Oct 04 12:04:00.283892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Roles: reader,member Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b32ff677e86d4be0b49869e579385a21", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}] Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Id: default Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Name: Default Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Id: 64e03bf24bb44add8adea800932e2f75 Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Name: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: method: > Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: exception: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.286597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: action_args: {'id': '34f12703-3e0e-4cad-ab29-1366fe553810'} Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:00.288112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.291019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.293007 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Returning 404 to user: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. {{(pid=133084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:00.293007 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b697dbfa-85a8-441a-970b-d91725265352 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 404 len: 111 microversion: 2.1 time: 0.059199 Oct 04 12:04:00.293007 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 61/115] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:00 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:00.442791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:00.448240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:00.452559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:00.453158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:00.453590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:00.454311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:00.454773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:00.455192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:00.471403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] HTTP exception thrown: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Request method failure captured: Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810/os-volume_attachments HTTP/1.1 Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDkYjOyp7jPI5zy0jR8LGcLYSW3KksboclL7eZHFImPuKsOriacdVFm6azElpCMjGRkCKJ-DpYIntKLuNqV64LS2vt9TPxAcpDtdpT_GizcWkcN7sJePY-7CpYxlr4TjrkvhiU9u8iQI3lx06D4Iu2g1o2W4L52Vy05Xrn7Cxs7GOY Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:04:00.476849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b32ff677e86d4be0b49869e579385a21", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}] Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 64e03bf24bb44add8adea800932e2f75 Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.479117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'server_id': '34f12703-3e0e-4cad-ab29-1366fe553810'} Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:00.480509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:00.483621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:00.491363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Returning 404 to user: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:00.491363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2e2dca0e-fade-4156-bf28-593a5dd4fecb tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040359 Oct 04 12:04:00.491363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 55/116] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:04:00 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:02.040763 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:02.041760 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:02.051160 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:02.052338 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:02.052869 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:02.054441 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:02.055320 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:02.056117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:02.079447 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.wsgi [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] HTTP exception thrown: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Request method failure captured: Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: request: DELETE /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 HTTP/1.1 Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept: application/json Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept-Encoding: identity Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Connection: close Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Length: 0 Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Type: application/json Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Host: 10.222.0.15 Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Openstack-System-Scope: None Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Auth-Token: gAAAAABjPCDkYjOyp7jPI5zy0jR8LGcLYSW3KksboclL7eZHFImPuKsOriacdVFm6azElpCMjGRkCKJ-DpYIntKLuNqV64LS2vt9TPxAcpDtdpT_GizcWkcN7sJePY-7CpYxlr4TjrkvhiU9u8iQI3lx06D4Iu2g1o2W4L52Vy05Xrn7Cxs7GOY Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Id: None Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Name: None Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Identity-Status: Confirmed Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Is-Admin-Project: True Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Id: default Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Name: Default Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Role: reader,member Oct 04 12:04:02.085137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Roles: reader,member Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b32ff677e86d4be0b49869e579385a21", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}] Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Id: default Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Name: Default Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Id: 64e03bf24bb44add8adea800932e2f75 Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Name: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: method: > Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: exception: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.087798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: action_args: {'id': '34f12703-3e0e-4cad-ab29-1366fe553810'} Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:02.089474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.092369 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.094794 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Returning 404 to user: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. {{(pid=133084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:02.094794 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b1b76169-9137-4057-b2c6-759ab8519a2b tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "DELETE /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 404 len: 111 microversion: 2.1 time: 0.051535 Oct 04 12:04:02.094794 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 62/117] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:04:02 2022] DELETE /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:04:02.104475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:02.105410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] [instance: 34f12703-3e0e-4cad-ab29-1366fe553810] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:02.122061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:02.122872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:02.123550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:02.124692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:02.125518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:02.126259 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:02.158583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] HTTP exception thrown: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Request method failure captured: Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 HTTP/1.1 Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDkYjOyp7jPI5zy0jR8LGcLYSW3KksboclL7eZHFImPuKsOriacdVFm6azElpCMjGRkCKJ-DpYIntKLuNqV64LS2vt9TPxAcpDtdpT_GizcWkcN7sJePY-7CpYxlr4TjrkvhiU9u8iQI3lx06D4Iu2g1o2W4L52Vy05Xrn7Cxs7GOY Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:04:02.162779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b32ff677e86d4be0b49869e579385a21", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b32ff677e86d4be0b49869e579385a21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b32ff677e86d4be0b49869e579385a21"}]}] Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: b32ff677e86d4be0b49869e579385a21 Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-DeleteServersTestJSON-1579171365 Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 64e03bf24bb44add8adea800932e2f75 Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-DeleteServersTestJSON-1579171365-project Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.167906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '34f12703-3e0e-4cad-ab29-1366fe553810'} Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:04:02.169786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. Oct 04 12:04:02.172695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:04:02.175086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] Returning 404 to user: Instance 34f12703-3e0e-4cad-ab29-1366fe553810 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:04:02.175086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-19deef98-68c8-41d1-a84b-f6683705ba18 tempest-DeleteServersTestJSON-1579171365 tempest-DeleteServersTestJSON-1579171365-project] 10.222.0.15 "GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810" status: 404 len: 111 microversion: 2.1 time: 0.072141 Oct 04 12:04:02.175086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 56/118] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:02 2022] GET /compute/v2.1/servers/34f12703-3e0e-4cad-ab29-1366fe553810 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:04:20.406427 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-543826161", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "networks": [{"uuid": "64d32325-38b8-47fc-b904-3c38443e31da"}]}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:20.425634 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:20.427279 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:20.531003 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] validate_networks() for [('64d32325-38b8-47fc-b904-3c38443e31da', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:04:22.063316 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:04:22.064442 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:04:22.066754 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:04:22.067492 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:04:22.068301 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:04:22.093222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:22.094827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:22.095991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:22.101550 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:22.104049 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:22.106504 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:22.155338 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Getting quotas for project df93e841cba9441f84c15a826db25de6. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:04:22.165106 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Getting quotas for user ee6a9052a75a4d8c9f4a08638685012b and project df93e841cba9441f84c15a826db25de6. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:04:22.189181 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:04:22.194274 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:04:22.431349 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-61289ee9-cc56-4c93-a1a6-adbba63bf08a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.032012 Oct 04 12:04:22.433575 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 63/119] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:04:22.455757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-01613b69-4649-4b51-ad96-60ed65e82787 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:22.465165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-01613b69-4649-4b51-ad96-60ed65e82787 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:22.469219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=18 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:22.470394 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=38 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:22.788477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-01613b69-4649-4b51-ad96-60ed65e82787 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:22.817827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-01613b69-4649-4b51-ad96-60ed65e82787 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1213 microversion: 2.1 time: 0.368994 Oct 04 12:04:22.834169 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 57/120] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:22 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1213 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:23.866456 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-483a0f94-6d1f-4e74-8935-d80c0962c4df tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:23.867903 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-483a0f94-6d1f-4e74-8935-d80c0962c4df tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:24.148058 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-483a0f94-6d1f-4e74-8935-d80c0962c4df tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:24.162080 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-483a0f94-6d1f-4e74-8935-d80c0962c4df tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1213 microversion: 2.1 time: 0.300926 Oct 04 12:04:24.162711 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 64/121] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:23 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1213 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:25.219726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:25.225970 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:25.257081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:25.258787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:25.260316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:25.262452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:25.264488 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:25.265517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:25.610730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:25.650382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-06d81b32-0b81-425d-abf1-ffbbe6be7725 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1217 microversion: 2.1 time: 0.453319 Oct 04 12:04:25.664211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 58/122] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:25 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1217 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:26.696129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:26.696129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:26.705443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:26.705946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:26.706384 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:26.707123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:26.709481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:26.709941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:26.806692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:26.813861 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2029931567", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:26.820319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-53e7bec6-abd3-4d84-890b-91ee22932183 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1209 microversion: 2.1 time: 0.130047 Oct 04 12:04:26.821543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 59/123] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:26 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:26.891780 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] validate_networks() for [('ea9a6710-a6c4-4b51-9ca2-9cfb36ef37b3', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:04:27.581011 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:04:27.581992 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:04:27.582778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:04:27.583501 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:04:27.584899 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:04:27.604533 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:27.605368 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:27.606098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:27.607401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:27.608132 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:27.608919 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:27.652816 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for project f4f180049cc049829e12eace469bef05. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:04:27.652816 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for user f3f607e48e534dd09c3619982978e9e5 and project f4f180049cc049829e12eace469bef05. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:04:27.673604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:04:27.678231 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:04:27.852840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:27.854172 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:27.868562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:27.868562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:27.868562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:27.868562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:27.869296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:27.869481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:27.963812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:27.971933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5aeb18cc-2606-4b95-9a05-8bbc172405ca tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1209 microversion: 2.1 time: 0.127327 Oct 04 12:04:27.972868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 60/124] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:27 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1209 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:27.991606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-35a6213c-9c11-4740-9f8c-8149956ec530 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.392065 Oct 04 12:04:27.998529 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 65/125] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:04:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:04:28.006028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1de3ec2c-bf96-4dd9-80ea-fc3c6f37b58c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:28.007149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1de3ec2c-bf96-4dd9-80ea-fc3c6f37b58c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:28.069086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1de3ec2c-bf96-4dd9-80ea-fc3c6f37b58c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:28.078872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1de3ec2c-bf96-4dd9-80ea-fc3c6f37b58c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1222 microversion: 2.1 time: 0.076438 Oct 04 12:04:28.079735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 61/126] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:28 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:28.418408 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-8587406", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:28.569472 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] validate_networks() for [('ea9a6710-a6c4-4b51-9ca2-9cfb36ef37b3', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:04:29.025177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:29.026294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:29.046625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:29.050504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:29.053258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:29.055034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:29.061564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:29.063150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:29.165401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:04:29.165401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:04:29.165401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:04:29.165401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:04:29.166260 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:04:29.190849 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:29.192163 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:29.192985 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:29.194844 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:29.195713 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:29.196568 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:29.248946 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for project f4f180049cc049829e12eace469bef05. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:04:29.270329 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for user f3f607e48e534dd09c3619982978e9e5 and project f4f180049cc049829e12eace469bef05. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:04:29.293597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:29.308488 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-217f2f8b-7d96-422c-85e4-1c864aa551f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1265 microversion: 2.1 time: 0.298753 Oct 04 12:04:29.310422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 62/127] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:29 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:29.317047 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:04:29.319776 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:04:29.633015 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-28fa29e8-6323-4723-9566-9f18dcea4c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.246912 Oct 04 12:04:29.633689 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 66/128] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:04:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:04:29.654569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-51dc7ca0-93dd-4d29-9b8b-c836773262a3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:29.657867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-51dc7ca0-93dd-4d29-9b8b-c836773262a3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:29.876592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-51dc7ca0-93dd-4d29-9b8b-c836773262a3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:29.887555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-51dc7ca0-93dd-4d29-9b8b-c836773262a3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1219 microversion: 2.1 time: 0.243945 Oct 04 12:04:29.888819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 63/129] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:29 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:30.366331 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:30.367512 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:30.385157 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:30.389932 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:30.390752 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:30.392092 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:30.399528 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:30.400825 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:30.582391 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:30.595978 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-3df0f844-f473-4af0-b50c-48913fa13339 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1273 microversion: 2.1 time: 0.244902 Oct 04 12:04:30.597134 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 67/130] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:30 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:30.941162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5ef73740-d3dd-46fa-b762-89542d384415 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:30.942494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5ef73740-d3dd-46fa-b762-89542d384415 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:31.141039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5ef73740-d3dd-46fa-b762-89542d384415 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:31.159315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5ef73740-d3dd-46fa-b762-89542d384415 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1219 microversion: 2.1 time: 0.234185 Oct 04 12:04:31.177170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 64/131] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:30 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1219 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:31.621728 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:31.622534 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:31.630865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:31.631460 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:31.631953 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:31.633065 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:31.633602 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:31.634119 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:31.706314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:31.716790 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9e0ac32c-b9be-460f-94a7-74fd481a8101 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1283 microversion: 2.1 time: 0.098924 Oct 04 12:04:31.717502 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 68/132] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:31 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:32.207122 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:32.207743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:32.214776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:32.215253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:32.215685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:32.216657 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:32.217409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:32.217871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:32.573118 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:32.583539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3d41f8d6-f7de-44d8-abbd-4849a6d8115c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1223 microversion: 2.1 time: 0.381142 Oct 04 12:04:32.584144 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 65/133] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:32 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1223 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:32.752753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:32.752753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:32.758334 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:32.758929 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:32.759598 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:32.760452 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:32.760957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:32.761423 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:32.913387 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:32.928674 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-3cc573ee-6d72-472d-a674-7cad1a9586de tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1325 microversion: 2.1 time: 0.186187 Oct 04 12:04:32.929701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 69/134] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:32 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:33.607136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:33.607800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:33.615070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:33.615469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:33.615904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:33.616816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:33.617294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:33.617722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:33.686066 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:33.694900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bbc54ccf-487a-4c3e-b866-98d00de8db96 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1223 microversion: 2.1 time: 0.092114 Oct 04 12:04:33.695496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 66/135] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:33 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:33.966151 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:33.966891 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:33.973218 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:33.973700 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:33.976766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:33.976766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:33.976766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:33.976766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:34.146900 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:34.156686 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-8ac58bdb-4183-4b8a-9a8b-89558f4c3f15 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1325 microversion: 2.1 time: 0.193957 Oct 04 12:04:34.157474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 70/136] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:33 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:34.719205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:34.719915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:34.727348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:34.727910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:34.728399 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:34.729157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:34.729620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:34.730042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:34.825033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:34.833942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b00ad5d1-7178-498a-abdb-b544051e95e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1223 microversion: 2.1 time: 0.118938 Oct 04 12:04:34.834537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 67/137] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:34 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:35.188012 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:35.191591 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:35.226984 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:35.227944 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:35.229724 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:35.231128 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:35.237086 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:35.237873 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:35.493021 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:35.510160 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-59270af1-7bc9-44f9-acc7-759f9850279c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1325 microversion: 2.1 time: 0.325879 Oct 04 12:04:35.510160 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 71/138] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:35 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1325 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:35.858084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:35.858703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:35.866368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:35.867444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:35.868462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:35.869212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:35.869665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:35.870098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:35.947010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:35.956743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0e45e098-7fb3-44b9-9ed5-c3177e492834 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1215 microversion: 2.1 time: 0.102615 Oct 04 12:04:35.957326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 68/139] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:35 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:36.219575 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-fe1b406d-c159-4526-8b9a-a6130c04809c req-180e3d66-82e4-4d85-87c2-9945c5a76798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af39632-30e5-4e5e-9048-61a84deace8c", "tag": "4d4e14bb-7a27-452c-ab60-61f73f12e85c"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:36.247211 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-fe1b406d-c159-4526-8b9a-a6130c04809c req-180e3d66-82e4-4d85-87c2-9945c5a76798 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:36.247883 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-fe1b406d-c159-4526-8b9a-a6130c04809c req-180e3d66-82e4-4d85-87c2-9945c5a76798 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:36.248583 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-fe1b406d-c159-4526-8b9a-a6130c04809c req-180e3d66-82e4-4d85-87c2-9945c5a76798 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:36.264342 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-fe1b406d-c159-4526-8b9a-a6130c04809c req-180e3d66-82e4-4d85-87c2-9945c5a76798 service nova] Creating event network-changed:4d4e14bb-7a27-452c-ab60-61f73f12e85c for instance 4af39632-30e5-4e5e-9048-61a84deace8c on hv-cinder-86021 Oct 04 12:04:36.271408 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-fe1b406d-c159-4526-8b9a-a6130c04809c req-180e3d66-82e4-4d85-87c2-9945c5a76798 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059340 Oct 04 12:04:36.271918 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 72/140] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:36.527565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:36.528107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:36.534451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:36.534918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:36.535451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:36.536307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:36.536810 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:36.537237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:36.704382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:36.713107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d9125627-7993-4879-92dd-68980c7d1a13 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.189560 Oct 04 12:04:36.713822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 69/141] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:36 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:36.996899 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:36.997602 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:37.009400 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:37.010258 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:37.011158 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:37.012465 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:37.013287 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:37.014055 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:37.110226 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:37.118558 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-3ff1d706-f913-48b6-8c0e-97664e7eaa07 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1215 microversion: 2.1 time: 0.126218 Oct 04 12:04:37.119316 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 73/142] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:36 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:37.738668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:37.739304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:37.746578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:37.747076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:37.747517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:37.748268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:37.748730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:37.749162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:37.896801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:37.905017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-884249ad-9d70-47e1-80ed-0f22233eaa26 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.170799 Oct 04 12:04:37.906401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 70/143] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:37 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:38.148294 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:38.148967 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:38.156162 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:38.156609 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:38.157048 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:38.157761 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:38.158220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:38.158659 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:38.231025 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:38.239910 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6d20e536-ed80-4a8e-9562-227315f5daa6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1215 microversion: 2.1 time: 0.095697 Oct 04 12:04:38.246047 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 74/144] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:38 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:38.929155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:38.930019 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:38.936970 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:38.937458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:38.937888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:38.939500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:38.939963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:38.940415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:39.096018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:39.105132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-08929598-0129-450b-803d-c3e034a77d36 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.179859 Oct 04 12:04:39.105714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 71/145] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:38 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:39.263917 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:39.270020 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:39.270020 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=6 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:39.272246 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:39.272744 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:39.273179 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:39.273896 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:39.274352 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:39.274772 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:39.296990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=20 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:39.367294 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:39.385712 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-518bb1bb-2e6c-46b8-a25a-e8e9efae9103 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1215 microversion: 2.1 time: 0.125643 Oct 04 12:04:39.386902 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 75/146] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:39 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:40.129775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:40.131146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:40.138510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:40.138999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:40.140765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:40.140933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:40.141323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:40.141745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:40.432320 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:40.433346 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:40.452875 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:40.455821 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:40.455821 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:40.456335 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:40.456679 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:40.457293 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:40.482255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:40.551192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7058eaf7-0a63-44ce-9422-6bf4eca663c3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.426160 Oct 04 12:04:40.553352 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 72/147] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:40 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:40.642995 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:40.669990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b95b31f0-ad0e-401a-8405-90d477a08214 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1271 microversion: 2.1 time: 0.244055 Oct 04 12:04:40.672709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 76/148] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:40 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1271 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:41.580240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:41.581031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:41.584571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=8 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:41.588970 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:41.589514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:41.590291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:41.591096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:41.591587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:41.592087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:41.733570 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:41.735177 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:41.743261 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:41.743962 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:41.744672 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:41.745806 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:41.746532 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:41.747105 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:41.804741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:41.817328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5bb5b749-2551-461b-a854-696b3452428e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.245151 Oct 04 12:04:41.818478 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 73/149] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:41 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:41.880832 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:41.897839 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-8a1f3294-7fcb-42e1-b919-1b259c6003e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1271 microversion: 2.1 time: 0.170277 Oct 04 12:04:41.898573 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 77/150] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:41 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:42.851119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:42.851864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:42.859361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:42.859688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:42.860129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:42.860876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:42.861343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:42.861769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:42.943901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:42.947330 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:42.966829 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:42.989832 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:42.989832 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:42.989832 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:42.989832 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:42.990796 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:43.099219 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:43.109765 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-1544f025-ca12-4cd0-afe8-c12191899362 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1279 microversion: 2.1 time: 0.186549 Oct 04 12:04:43.110786 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 78/151] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:42 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:43.285634 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:43.287764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ba32107a-2009-4865-b060-99190b64d45b tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.442804 Oct 04 12:04:43.288903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 74/152] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:42 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:43.681298 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:43.682164 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:43.689163 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:43.690220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:43.690752 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:43.691454 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:43.691903 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:43.692368 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:43.721701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a7466523-f722-45cd-9d6c-9083d39dbf0f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/ips" status: 200 len: 146 microversion: 2.1 time: 0.047533 Oct 04 12:04:43.722299 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 79/153] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:04:43 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:43.751783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-66cefce8-f750-47e2-bf95-06645ba1749f req-0e815296-0dc2-4066-ab60-4217b5cf2cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dbf236-4a32-4b65-b4b5-6e75f778f934", "tag": "6724c60b-cea7-42fb-a13e-99399f296c39"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:43.762320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-66cefce8-f750-47e2-bf95-06645ba1749f req-0e815296-0dc2-4066-ab60-4217b5cf2cfc service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:43.763081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-66cefce8-f750-47e2-bf95-06645ba1749f req-0e815296-0dc2-4066-ab60-4217b5cf2cfc service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:43.763658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-66cefce8-f750-47e2-bf95-06645ba1749f req-0e815296-0dc2-4066-ab60-4217b5cf2cfc service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:43.777149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-66cefce8-f750-47e2-bf95-06645ba1749f req-0e815296-0dc2-4066-ab60-4217b5cf2cfc service nova] Creating event network-changed:6724c60b-cea7-42fb-a13e-99399f296c39 for instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 on hv-cinder-86021 Oct 04 12:04:43.783875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-66cefce8-f750-47e2-bf95-06645ba1749f req-0e815296-0dc2-4066-ab60-4217b5cf2cfc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042647 Oct 04 12:04:43.785159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 75/154] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:44.160856 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:44.167782 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:44.197350 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.198661 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.199868 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.201679 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.203443 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.204975 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.321344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:44.321344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:44.328789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.329309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.329742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.330489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.330927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.331467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.370626 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:44.388352 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9337f815-a0d8-4ff3-8d41-4f1e964c5798 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1277 microversion: 2.1 time: 0.237343 Oct 04 12:04:44.390376 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 80/155] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:44 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:44.625244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:44.628830 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:44.631059 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:44.639469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6e52190a-86f4-4110-a395-4e5e8a84ce80 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.331905 Oct 04 12:04:44.641395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 76/156] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:44 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:44.648602 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.667193 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.667696 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.668495 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:44.668968 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:44.669394 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:44.714476 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b18a8fd2-6b03-49f6-99ab-c7cec8a63d6b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/ips" status: 200 len: 148 microversion: 2.1 time: 0.099813 Oct 04 12:04:44.739672 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 81/157] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:04:44 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/ips => generated 148 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:45.431346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:45.432560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:45.480955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.489460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.495081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:45.496684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.497545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.498340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:45.668498 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:45.669814 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:45.682992 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.684718 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.685525 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:45.687076 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:45.688570 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:45.689177 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:46.078103 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:46.094437 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-72423a61-d289-4680-b079-86374c0205a8 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.433698 Oct 04 12:04:46.096698 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 82/158] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:45 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:46.138310 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:46.152700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-03ccc1e9-a778-433c-83a4-714e988b35df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.735330 Oct 04 12:04:46.154881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 77/159] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:45 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:46.885376 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-c0b1c221-6786-432b-b189-0b1b46a2f7ac req-6edd9af5-bd21-473e-9d74-149268f4c73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af39632-30e5-4e5e-9048-61a84deace8c", "name": "network-vif-plugged", "status": "completed", "tag": "4d4e14bb-7a27-452c-ab60-61f73f12e85c"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:46.906355 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-c0b1c221-6786-432b-b189-0b1b46a2f7ac req-6edd9af5-bd21-473e-9d74-149268f4c73a service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:46.910067 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-c0b1c221-6786-432b-b189-0b1b46a2f7ac req-6edd9af5-bd21-473e-9d74-149268f4c73a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:46.912733 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-c0b1c221-6786-432b-b189-0b1b46a2f7ac req-6edd9af5-bd21-473e-9d74-149268f4c73a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:46.942529 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-c0b1c221-6786-432b-b189-0b1b46a2f7ac req-6edd9af5-bd21-473e-9d74-149268f4c73a service nova] Creating event network-vif-plugged:4d4e14bb-7a27-452c-ab60-61f73f12e85c for instance 4af39632-30e5-4e5e-9048-61a84deace8c on hv-cinder-86021 Oct 04 12:04:46.972729 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-c0b1c221-6786-432b-b189-0b1b46a2f7ac req-6edd9af5-bd21-473e-9d74-149268f4c73a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090991 Oct 04 12:04:46.974399 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 83/160] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:47.153052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:47.154206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:47.180356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:47.181219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:47.181971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:47.183276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:47.184126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:47.184859 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:47.184977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:47.185944 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:47.203365 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:47.207870 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:47.208860 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:47.211961 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:47.214749 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:47.214749 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:47.250085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:47.252807 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=100 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:47.517836 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:47.533893 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e59346f4-8d49-4397-8308-66c69c9af5f3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.356543 Oct 04 12:04:47.542639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 84/161] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:47 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:47.562909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:47.599467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c554d59c-4a63-428c-b95e-20c18e43637a tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1313 microversion: 2.1 time: 0.454880 Oct 04 12:04:47.607534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 78/162] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:47 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:47.777496 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-1201dcb8-c857-4a9f-86b8-11e8642d8390 req-02b807f3-f05a-44e1-a495-9a976864259a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0451fc1-f1f4-40fb-bf24-186562ff1514", "tag": "963f263d-76df-47c8-9d84-157b7812a5a5"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:47.810564 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-1201dcb8-c857-4a9f-86b8-11e8642d8390 req-02b807f3-f05a-44e1-a495-9a976864259a service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:47.812797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-1201dcb8-c857-4a9f-86b8-11e8642d8390 req-02b807f3-f05a-44e1-a495-9a976864259a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:47.813304 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-1201dcb8-c857-4a9f-86b8-11e8642d8390 req-02b807f3-f05a-44e1-a495-9a976864259a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:47.837987 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-1201dcb8-c857-4a9f-86b8-11e8642d8390 req-02b807f3-f05a-44e1-a495-9a976864259a service nova] Creating event network-changed:963f263d-76df-47c8-9d84-157b7812a5a5 for instance a0451fc1-f1f4-40fb-bf24-186562ff1514 on hv-cinder-86021 Oct 04 12:04:47.843607 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-1201dcb8-c857-4a9f-86b8-11e8642d8390 req-02b807f3-f05a-44e1-a495-9a976864259a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072110 Oct 04 12:04:47.844718 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 85/163] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:47.899848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4b7f52a-5dac-4971-bb64-eb2f1d347d65"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:47.902904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:47.909939 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:47.910494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:47.910934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:47.911721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:47.912211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:47.912645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:48.502552 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af67dc62-9bea-4aa5-bce4-5c3512d1657c"}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:48.510139 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:48.532577 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:48.539566 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:48.540519 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:48.541862 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:48.542697 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:48.543485 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:49.460903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e7045723-1e24-4acb-839d-db3fba3c53be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.562100 Oct 04 12:04:49.464818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 79/164] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:04:47 2022] POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-volume_attachments => generated 194 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:49.477986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:49.479053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:49.516952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:49.518226 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:49.519262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:49.520862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:49.524191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:49.532943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:50.207969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:50.242271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cab57295-8698-485c-9d90-79ee67b2d727 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.775230 Oct 04 12:04:50.242822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 80/165] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:49 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:50.260387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:50.261441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:50.270032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:50.270818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:50.272086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:50.277899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:50.282932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:50.283484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:50.317753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-31b1af8d-31ca-425b-83ec-566adb6772e4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.808258 Oct 04 12:04:50.325813 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 86/166] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:04:48 2022] POST /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments => generated 194 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:50.859178 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-e8bd3292-8ac0-4b1b-8b13-4db9169f4918 req-cd807e1e-2dee-492e-9d09-d7be4df4b830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dbf236-4a32-4b65-b4b5-6e75f778f934", "name": "network-vif-plugged", "status": "completed", "tag": "6724c60b-cea7-42fb-a13e-99399f296c39"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:50.916061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:50.921992 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-e8bd3292-8ac0-4b1b-8b13-4db9169f4918 req-cd807e1e-2dee-492e-9d09-d7be4df4b830 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:50.921992 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-e8bd3292-8ac0-4b1b-8b13-4db9169f4918 req-cd807e1e-2dee-492e-9d09-d7be4df4b830 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:50.924876 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-e8bd3292-8ac0-4b1b-8b13-4db9169f4918 req-cd807e1e-2dee-492e-9d09-d7be4df4b830 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:50.935530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5c4a903d-2ea6-4f32-83bd-3fadcd46098e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1498 microversion: 2.1 time: 0.688436 Oct 04 12:04:50.943696 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 81/167] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:50 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1498 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:50.992954 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-e8bd3292-8ac0-4b1b-8b13-4db9169f4918 req-cd807e1e-2dee-492e-9d09-d7be4df4b830 service nova] Creating event network-vif-plugged:6724c60b-cea7-42fb-a13e-99399f296c39 for instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 on hv-cinder-86021 Oct 04 12:04:51.003401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-e8bd3292-8ac0-4b1b-8b13-4db9169f4918 req-cd807e1e-2dee-492e-9d09-d7be4df4b830 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156137 Oct 04 12:04:51.009146 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 87/168] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:04:51.296526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:51.297849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:51.335819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:51.337018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:51.337654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:51.338842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:51.339852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:51.340548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:51.581453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:51.599626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-28f6f4b4-2f67-4ccd-8a27-843de15fdb63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.315869 Oct 04 12:04:51.601845 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 82/169] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:51 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:52.187651 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:52.193682 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:52.196819 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.197315 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.197744 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:52.198451 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.199069 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.199644 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:52.268450 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Going to try to terminate instance {{(pid=133084) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:04:52.636364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:52.636364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:52.649900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.651659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.653527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:52.654879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.656729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.658063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:52.771541 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:52.911229 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-ecf69bdb-cda4-422a-9157-b910354fc465 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 204 len: 0 microversion: 2.1 time: 0.728141 Oct 04 12:04:52.921825 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 88/170] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:04:52 2022] DELETE /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 0 bytes in 734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:04:52.932611 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:52.934330 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:52.948204 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.949177 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.949990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:52.951220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:52.952091 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:52.952883 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:53.198073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:53.210085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e798a05e-19ee-417c-b49d-00da457bdd57 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.588391 Oct 04 12:04:53.225495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 83/171] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:52 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:53.417261 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:53.425702 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-7f794ece-ce3c-4303-974b-f61beacb9334 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1504 microversion: 2.1 time: 0.501048 Oct 04 12:04:53.428124 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 89/172] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:52 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1504 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:54.237585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:54.238571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:54.256791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:54.257295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:54.257709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:54.258481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:54.258938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:54.259355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:54.452552 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:54.453898 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:54.463081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:54.463606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:54.464249 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:54.465179 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:54.465646 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:54.466238 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:54.611755 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:54.622211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c6ab1f1a-c9eb-4977-b63a-1451fe76157a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.388896 Oct 04 12:04:54.623351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 84/173] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:54 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:54.871318 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:54.921736 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-685e116d-c1b8-4e85-9a7f-abfc229399e5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1504 microversion: 2.1 time: 0.473101 Oct 04 12:04:54.942399 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 90/174] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:54 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:55.663648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:55.670391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:55.676401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=65 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:04:55.702908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:55.714367 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:55.716535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:55.739164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:55.739164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:55.739164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:55.992613 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:55.992613 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:56.035404 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:56.036360 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:56.037160 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:56.039238 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:56.041118 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:56.042680 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:56.770749 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:56.788343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:56.820252 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-aee96550-1109-41fb-897b-66185fa598e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 1.149434 Oct 04 12:04:56.820252 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 85/175] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:55 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:56.844960 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-20825001-0529-4564-b77e-a4454cdba41e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1504 microversion: 2.1 time: 0.863182 Oct 04 12:04:56.844960 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 91/176] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:55 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1504 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:04:57.670081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-cd9ded86-2150-4c9e-ae0a-22136a5b380c req-6a85e872-5666-47cf-b8e9-863a2511da1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0451fc1-f1f4-40fb-bf24-186562ff1514", "name": "network-vif-plugged", "status": "completed", "tag": "963f263d-76df-47c8-9d84-157b7812a5a5"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:57.747680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-cd9ded86-2150-4c9e-ae0a-22136a5b380c req-6a85e872-5666-47cf-b8e9-863a2511da1f service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:57.750769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-cd9ded86-2150-4c9e-ae0a-22136a5b380c req-6a85e872-5666-47cf-b8e9-863a2511da1f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:57.751637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-cd9ded86-2150-4c9e-ae0a-22136a5b380c req-6a85e872-5666-47cf-b8e9-863a2511da1f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:57.811392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-cd9ded86-2150-4c9e-ae0a-22136a5b380c req-6a85e872-5666-47cf-b8e9-863a2511da1f service nova] Creating event network-vif-plugged:963f263d-76df-47c8-9d84-157b7812a5a5 for instance a0451fc1-f1f4-40fb-bf24-186562ff1514 on hv-cinder-86021 Oct 04 12:04:57.825029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-cd9ded86-2150-4c9e-ae0a-22136a5b380c req-6a85e872-5666-47cf-b8e9-863a2511da1f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163832 Oct 04 12:04:57.827475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 86/177] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:57.860674 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:57.862752 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:57.878658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:57.882559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:57.892314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:57.893441 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:57.894623 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:57.897589 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:57.901901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:57.926468 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:57.931881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:57.936953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:57.938237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:57.944506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:57.958887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:57.958887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:58.375680 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:58.400466 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f450be04-096e-45b1-91e1-c563d0897b4b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.548578 Oct 04 12:04:58.403402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:58.411134 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 92/178] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:57 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:58.417417 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a40c379f-0a53-44f5-a86f-193bec2b22e3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1504 microversion: 2.1 time: 0.547665 Oct 04 12:04:58.418323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 87/179] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:57 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:04:58.556536 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-219b0693-7621-4380-85b8-993db498d68d req-5650ed62-44cb-4231-b06e-662ba224be0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af39632-30e5-4e5e-9048-61a84deace8c", "name": "network-vif-deleted", "tag": "4d4e14bb-7a27-452c-ab60-61f73f12e85c"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:04:58.567990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-219b0693-7621-4380-85b8-993db498d68d req-5650ed62-44cb-4231-b06e-662ba224be0c service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:58.568811 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-219b0693-7621-4380-85b8-993db498d68d req-5650ed62-44cb-4231-b06e-662ba224be0c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:58.569284 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-219b0693-7621-4380-85b8-993db498d68d req-5650ed62-44cb-4231-b06e-662ba224be0c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:58.582836 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-219b0693-7621-4380-85b8-993db498d68d req-5650ed62-44cb-4231-b06e-662ba224be0c service nova] Creating event network-vif-deleted:4d4e14bb-7a27-452c-ab60-61f73f12e85c for instance 4af39632-30e5-4e5e-9048-61a84deace8c on hv-cinder-86021 Oct 04 12:04:58.592098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-219b0693-7621-4380-85b8-993db498d68d req-5650ed62-44cb-4231-b06e-662ba224be0c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038510 Oct 04 12:04:58.596457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 93/180] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:04:59.434234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:59.438458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:59.460684 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:04:59.468606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:04:59.475721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:59.480200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:59.480953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:59.481886 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:59.483763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:59.495851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:59.500832 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:59.506927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:59.509555 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:59.515517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:04:59.516764 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:04:59.517923 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:04:59.770583 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:04:59.805756 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-c823bee6-d78b-44aa-9262-e2f27d793cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1462 microversion: 2.1 time: 0.361940 Oct 04 12:04:59.810133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 94/181] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:59 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1462 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:00.208483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:00.248875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-eaaf307e-2061-484d-8db0-4e3257f5ecea tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.815671 Oct 04 12:05:00.267972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 88/182] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:04:59 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:00.866897 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:00.868425 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:00.878992 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:00.881576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:00.882406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:00.883893 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:00.885173 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:00.885899 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:01.137616 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:01.164000 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-de99729a-8d76-48f8-8505-11a2ee6b490f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1462 microversion: 2.1 time: 0.305834 Oct 04 12:05:01.166446 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 95/183] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:00 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1462 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:01.298855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:01.299709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:01.318842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:01.321402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:01.324856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:01.330800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:01.331872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:01.333066 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:01.704110 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:01.744822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-eb1e9e5e-1f87-40b2-8313-fbf89ee96b17 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.437562 Oct 04 12:05:01.746105 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 89/184] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:01 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:02.209248 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:02.217529 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:02.240455 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:02.240957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:02.241396 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:02.242213 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:02.242607 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:02.243119 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:02.345780 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:02.346330 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:02.346776 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:02.353392 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.objects.instance [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lazy-loading 'fault' on Instance uuid 4af39632-30e5-4e5e-9048-61a84deace8c {{(pid=133084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:05:02.424705 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:02.434181 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-19f0cc28-36d4-4694-a3ac-9484143a5911 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1303 microversion: 2.1 time: 0.229703 Oct 04 12:05:02.434936 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 96/185] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:02 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:02.788484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:02.790861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:02.816592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:02.839709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:02.840677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:02.842109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:02.843033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:02.844826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:03.163685 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-26feccd4-a30d-487a-97d3-3bb4adf8eb6b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:03.179176 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26feccd4-a30d-487a-97d3-3bb4adf8eb6b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:03.179985 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26feccd4-a30d-487a-97d3-3bb4adf8eb6b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:03.189470 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26feccd4-a30d-487a-97d3-3bb4adf8eb6b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:03.341639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-26feccd4-a30d-487a-97d3-3bb4adf8eb6b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Going to try to stop instance {{(pid=133084) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 12:05:03.505533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:03.532598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9ca1a1f4-248c-4bed-ac06-69cf172def30 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1319 microversion: 2.1 time: 0.756690 Oct 04 12:05:03.533010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 90/186] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:02 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:03.539932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:03.540588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:03.563817 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:03.564441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:03.564887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:03.565835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:03.566451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:03.566896 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:03.621981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-26feccd4-a30d-487a-97d3-3bb4adf8eb6b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action" status: 202 len: 0 microversion: 2.1 time: 0.463079 Oct 04 12:05:03.623072 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 97/187] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:05:03 2022] POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:05:03.633921 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:03.635021 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:03.641329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:03.643818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:03.647126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:03.647888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lazy-loading 'fault' on Instance uuid 4af39632-30e5-4e5e-9048-61a84deace8c {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:05:03.656784 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:03.661960 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:03.661960 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:03.661960 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:03.661960 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:03.662329 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:03.988594 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:04.015053 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:04.021081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a4e3dede-aa92-400c-8601-724aabec84d7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.391409 Oct 04 12:05:04.022981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 98/188] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:03 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:04.360329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:04.372130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-34efc158-4f0a-4ab6-a04a-7f25ecc2838c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 200 len: 1303 microversion: 2.1 time: 0.837992 Oct 04 12:05:04.374580 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 91/189] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:03 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 1303 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:04.565428 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:04.566237 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:04.589174 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:04.589858 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:04.590916 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:04.594223 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:04.594864 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:04.597627 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:05.030169 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:05.044400 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-00490bf6-9918-4eca-889f-097517afe2b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1512 microversion: 2.1 time: 0.489212 Oct 04 12:05:05.046156 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 99/190] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:04 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:05.068350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:05.068750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:05.080274 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:05.084550 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:05.087278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:05.088035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:05.088866 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:05.089728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:05.090315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:05.090858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:05.092221 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:05.092697 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:05.093319 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:05.094065 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:05.094506 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:05.095165 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:05.144766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.objects.instance [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lazy-loading 'flavor' on Instance uuid a0451fc1-f1f4-40fb-bf24-186562ff1514 {{(pid=133084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:05:05.616630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:05.654610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-277198a4-8c80-45d6-856d-6d4491e9cfe7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.597968 Oct 04 12:05:05.671297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 92/191] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:05 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:05.714475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:05.715861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 4af39632-30e5-4e5e-9048-61a84deace8c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:05.742672 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:05.743790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:05.745380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:05.752838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:05.754692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:05.755376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:05.784039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] HTTP exception thrown: Instance 4af39632-30e5-4e5e-9048-61a84deace8c could not be found. Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Request method failure captured: Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c HTTP/1.1 Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFAouycuriYsav_coo48j_fRJEfNcNEuzaOz9289Wfp2A78kl2oAjHHtij5G-Z_1g_NjS9XT5jivmj0TEceqnBvpCh6ZMV7UluY0f4yRO2AiImPV4MfRo1xNVU_m6ltEp_bPwyFMt-wSh6sU6ji9hwXjiQwFD4p8ZoRgzCALGUS1ho Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: df93e841cba9441f84c15a826db25de6 Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesActionsTest-617245700 Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:05:05.799080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_df93e841cba9441f84c15a826db25de6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/df93e841cba9441f84c15a826db25de6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/df93e841cba9441f84c15a826db25de6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/df93e841cba9441f84c15a826db25de6"}]}] Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesActionsTest-617245700 Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: df93e841cba9441f84c15a826db25de6 Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesActionsTest-617245700 Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesActionsTest-617245700-project Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: ee6a9052a75a4d8c9f4a08638685012b Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesActionsTest-617245700-project Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 4af39632-30e5-4e5e-9048-61a84deace8c could not be found. Oct 04 12:05:05.800514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '4af39632-30e5-4e5e-9048-61a84deace8c'} Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af39632-30e5-4e5e-9048-61a84deace8c could not be found. Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:05:05.801230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af39632-30e5-4e5e-9048-61a84deace8c could not be found. Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af39632-30e5-4e5e-9048-61a84deace8c could not be found. Oct 04 12:05:05.802353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:05:05.810813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Returning 404 to user: Instance 4af39632-30e5-4e5e-9048-61a84deace8c could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:05:05.812494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f426b647-5ad5-472f-b7f8-d95fe3521411 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c" status: 404 len: 111 microversion: 2.1 time: 0.141970 Oct 04 12:05:05.819326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 93/192] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:05 2022] GET /compute/v2.1/servers/4af39632-30e5-4e5e-9048-61a84deace8c => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:05:06.001302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-770440086", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "networks": [{"uuid": "64d32325-38b8-47fc-b904-3c38443e31da"}]}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:06.073413 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-539a9b49-19d7-4e9b-81bd-21666403bf16 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514/action" status: 200 len: 32 microversion: 2.1 time: 0.998145 Oct 04 12:05:06.102595 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 100/193] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:05:05 2022] POST /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514/action => generated 32 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 12:05:06.121717 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] validate_networks() for [('64d32325-38b8-47fc-b904-3c38443e31da', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:05:06.130666 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:06.132149 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:06.152518 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:06.154560 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:06.156624 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:06.158551 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:06.159809 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:06.161117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:06.468730 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:06.481788 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e32ef8fe-2b31-4d85-8646-c5c3d47c4d32 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.376736 Oct 04 12:05:06.486083 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 101/194] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:06 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:06.702500 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:06.704498 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:06.745209 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:06.746751 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:06.749002 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:06.759257 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:06.761579 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:06.765821 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:07.326183 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:07.337875 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-de3f80ee-6d1b-494d-b477-1ea0cde83952 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.645569 Oct 04 12:05:07.344701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 102/195] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:06 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:07.539179 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:07.540274 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:07.550884 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:07.551997 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:07.553582 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:07.554819 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:07.555584 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:07.558748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:07.632654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:05:07.634042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:05:07.634817 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:05:07.639177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:05:07.639177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:05:07.660546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:07.663245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:07.664016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:07.665325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:07.666393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:07.668637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:07.716955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Getting quotas for project df93e841cba9441f84c15a826db25de6. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:07.749765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Getting quotas for user ee6a9052a75a4d8c9f4a08638685012b and project df93e841cba9441f84c15a826db25de6. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:07.792469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:05:07.800617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:05:07.898735 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:07.908890 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-86976f88-6796-4dbe-a125-41a931ce9f90 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.378698 Oct 04 12:05:07.910060 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 103/196] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:07 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:08.070434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-682e9aa0-5d8a-4f48-bbc5-92e4f781f0f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074771 Oct 04 12:05:08.083162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 94/197] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:05:08.086287 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-8328bb4d-489b-432a-a492-487fad4e0b6f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:08.087629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-8328bb4d-489b-432a-a492-487fad4e0b6f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:08.198927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-8328bb4d-489b-432a-a492-487fad4e0b6f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:08.211855 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-8328bb4d-489b-432a-a492-487fad4e0b6f tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1213 microversion: 2.1 time: 0.130504 Oct 04 12:05:08.213285 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 104/198] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:08 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:08.367653 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:08.368860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:08.377381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:08.378269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:08.378929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:08.379888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:08.380821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:08.381493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:08.387192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:08.430846 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-0524d9cd-17e8-49ca-8887-1db35707e830 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: .version_select at 0x7f10c38bd550>, body: {"keypair": {"name": "tempest-keypair-1180181464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNm6qK0DC2PmDT2NA3NMVOHMV7Fat3R6j4bvs2jM6GHzIOmO6BriGFGMZWpv9YeLxYEx50m112DHENs5Z/ouzqjIDcC6E0qX28h/wuCwiv3NUciBi46MaMt59cGRKs4PQ=="}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:08.490492 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-0524d9cd-17e8-49ca-8887-1db35707e830 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:08.497957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-0524d9cd-17e8-49ca-8887-1db35707e830 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:08.689095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:08.703128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-64f52582-aa10-4155-9851-f6086d6a068a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.339553 Oct 04 12:05:08.704484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 95/199] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:08 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:08.712158 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-0524d9cd-17e8-49ca-8887-1db35707e830 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.285501 Oct 04 12:05:08.713413 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 105/200] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:05:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:05:08.932966 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:08.933936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:08.940808 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:08.941624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:08.941881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:08.948407 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:08.957787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:08.960360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:09.241137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f3033a3d-a2fd-431c-9faa-3bf414e86020 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:09.244905 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f3033a3d-a2fd-431c-9faa-3bf414e86020 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:09.348683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:09.361388 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b2c3c09f-4a09-422d-80b2-85ef82cb65ac tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.431759 Oct 04 12:05:09.376357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 96/201] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:08 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:09.376552 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f3033a3d-a2fd-431c-9faa-3bf414e86020 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:09.406161 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f3033a3d-a2fd-431c-9faa-3bf414e86020 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1213 microversion: 2.1 time: 0.170347 Oct 04 12:05:09.409576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 106/202] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:09 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:09.731596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:09.737837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:09.748740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:09.749241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:09.749677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:09.750390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:09.750843 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:09.751267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:10.387206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:10.399666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c451280d-4101-4879-ac25-9979c3aba27b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.676439 Oct 04 12:05:10.405994 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:10.415469 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:10.420816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 97/203] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:09 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:10.449646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:10.455222 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:10.461631 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:10.468709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:10.469402 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:10.478014 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:10.481499 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:10.482813 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:10.492885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:10.493792 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:10.494583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:10.495885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:10.496779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:10.510333 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:10.886762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:10.909119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8e2d3244-ff55-4f00-b528-56b32fbb3f51 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1217 microversion: 2.1 time: 0.481674 Oct 04 12:05:10.920707 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 98/204] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:10 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1217 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:11.305947 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:11.322527 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-fb26569c-07cd-4870-9953-6e05a44ab4e7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.922534 Oct 04 12:05:11.325665 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 107/205] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:10 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:11.438711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:11.442487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:11.466024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:11.470462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:11.471155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:11.477263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:11.478021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:11.479925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:11.934603 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:11.936506 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:11.947663 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:11.948542 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:11.949222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:11.950208 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:11.951622 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:11.952753 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:12.088512 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:12.133949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:12.134497 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5b8bc8a2-7530-4f5d-b8fd-60bce8a762c2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1217 microversion: 2.1 time: 0.204749 Oct 04 12:05:12.134944 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 108/206] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:11 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1217 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:12.152528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f2406a11-13f2-41f6-b0bd-9c71f2f121ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.721714 Oct 04 12:05:12.153329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 99/207] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:11 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:12.354118 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:12.354950 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:12.365729 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:12.367591 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:12.369244 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:12.371618 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:12.374291 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:12.376093 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:12.627766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:12.677946 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-58b4f3eb-06e4-46fb-9a1f-254e1c65d3ca tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.328296 Oct 04 12:05:12.679705 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 109/208] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:12 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:13.164204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:13.166963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:13.180203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:13.187330 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:13.206157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:13.206157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:13.206545 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:13.206711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:13.206711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:13.206711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:13.220561 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:13.228846 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:13.234466 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:13.241976 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:13.253817 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:13.254625 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:13.437457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:13.473644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6945ce79-f99d-4521-907f-e38bd02d9a2c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1209 microversion: 2.1 time: 0.317408 Oct 04 12:05:13.474728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 100/209] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:13 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1209 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:13.710676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:13.711616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:13.734470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:13.735086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:13.739000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:13.745879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:13.746857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:13.749179 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:14.326367 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:14.345867 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-954909ce-fec3-446e-85e3-373ddd5d3709 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 1.167013 Oct 04 12:05:14.352733 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 110/210] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:13 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:14.521039 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:14.522156 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:14.556581 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:14.560144 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:14.566929 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:14.568311 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:14.569173 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:14.569948 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:14.664735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:14.687689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f7dab39f-1707-4e4c-938f-dd6c69785410 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.984822 Oct 04 12:05:14.709090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 101/211] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:13 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:14.789601 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:14.802566 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e28cecf0-964b-42bf-b1d5-bbad7aa29cd0 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1265 microversion: 2.1 time: 0.292921 Oct 04 12:05:14.803326 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 111/212] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:14 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:15.396140 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:15.397979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:15.430914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:15.431808 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:15.432663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:15.434097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:15.442814 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:15.442814 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:15.719629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:15.732643 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:15.737660 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:15.738943 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:15.739614 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:15.742318 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:15.743054 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:15.744275 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:16.041770 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:16.069167 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9ace0ae4-4e45-465b-bd8c-2211ec24709c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.356394 Oct 04 12:05:16.084627 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 112/213] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:15 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:16.093632 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:16.094260 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:16.101853 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:16.102576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:16.103194 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:16.104127 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:16.104817 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:16.105523 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:16.244738 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:16.260726 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-abc43c05-71cf-453a-8a03-ca7924dc487e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1283 microversion: 2.1 time: 0.174420 Oct 04 12:05:16.262293 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 113/214] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:16 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:16.414196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:16.445049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-36e79c71-1508-433f-8cc0-918e836ce4fc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 1.056982 Oct 04 12:05:16.449209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 102/215] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:15 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:17.080113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1469816937", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a843603-1123-4e00-9b28-113fe25ca6eb"}], "security_groups": [{"name": "tempest-securitygroup--927018450"}], "key_name": "tempest-keypair-1180181464", "user_data": "}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:17.100995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:17.101626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:17.118246 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:17.118743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:17.119199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:17.119919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:17.120414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:17.129077 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:17.655721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:17.656980 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] validate_networks() for [('6a843603-1123-4e00-9b28-113fe25ca6eb', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:05:17.658025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9a96d53c-6c11-43dd-acb8-1b88a7576936 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.463046 Oct 04 12:05:17.658025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 103/216] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:17 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:17.658025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:17.658025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:17.658025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:17.659813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:17.659813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:17.659813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:17.659813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:17.660790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:17.684616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:17.722635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:17.731607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6f0805b3-77eb-4bbf-aac4-b8f0c4bd3af7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1271 microversion: 2.1 time: 0.164102 Oct 04 12:05:17.735969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 104/217] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:17 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:17.743398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:17.743398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:17.768428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:17.769117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:17.769668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:17.770527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:17.775065 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:17.775654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:17.776312 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=6 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:18.348489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:18.363595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b24b2f93-fc4b-4783-908b-a4d3e130e8ba tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.623742 Oct 04 12:05:18.364265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 105/218] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:17 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:18.625290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:18.625953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:18.644081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:18.644635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:18.645081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:18.645814 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:18.646270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:18.646701 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:18.942319 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:05:18.943172 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:05:18.944102 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:05:18.944102 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:05:18.944692 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:05:18.962328 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:18.962991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:18.964665 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:18.966379 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:18.967973 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:18.968619 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:19.015216 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:19.025195 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:19.057345 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:05:19.062618 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:05:19.141982 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:19.154823 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4d445923-6885-4191-8aba-047852700a99 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.534250 Oct 04 12:05:19.155975 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 106/219] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:18 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:19.162197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:19.162814 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:19.170926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:19.171674 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:19.172373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:19.173839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:19.175901 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:19.176967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:19.329172 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d674d565-b899-4a97-afcc-6540fe4fe1f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.249702 Oct 04 12:05:19.333798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 114/220] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:05:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:05:19.345907 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6de0e98e-825f-45cb-a821-bc7e7517032f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:19.346893 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6de0e98e-825f-45cb-a821-bc7e7517032f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:19.511405 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6de0e98e-825f-45cb-a821-bc7e7517032f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:19.526980 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6de0e98e-825f-45cb-a821-bc7e7517032f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1242 microversion: 2.1 time: 0.184497 Oct 04 12:05:19.529081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 115/221] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:19 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1242 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:19.537257 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:19.537900 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:19.547731 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:19.548848 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:19.549297 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:19.550733 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:19.551200 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:19.551640 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:20.169120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:20.169120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ea1b17cb-9add-4448-a147-a74c5549546c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.857624 Oct 04 12:05:20.169120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 107/222] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:19 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:20.172726 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:20.172726 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-c9d6efed-f938-4d7c-8efc-4b246f3cc0e9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1722 microversion: 2.1 time: 0.560473 Oct 04 12:05:20.172726 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 116/223] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:19 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1722 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:20.197221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:20.198215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:20.213864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:20.214679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:20.215307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:20.216746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:20.217212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:20.220544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:20.561829 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a9b66ee7-ae4b-4918-9f83-10678731bc72 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:20.567094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a9b66ee7-ae4b-4918-9f83-10678731bc72 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:20.785536 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-a9b66ee7-ae4b-4918-9f83-10678731bc72 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:20.803517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a9b66ee7-ae4b-4918-9f83-10678731bc72 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1242 microversion: 2.1 time: 0.249488 Oct 04 12:05:20.817617 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 117/224] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:20 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:20.946618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:20.979111 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8c14fd3a-cc76-4d5c-b6a9-ed89c3a1a910 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.785557 Oct 04 12:05:20.983168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 108/225] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:20 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:21.073110 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:21.074542 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:21.107235 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:21.109030 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:21.123557 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:21.124840 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:21.125700 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:21.126482 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:21.196194 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:21.200587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:21.248747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:21.252330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:21.253812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:21.255862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:21.261032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:21.264197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:21.667308 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:21.697931 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f4be36a1-a251-4dfe-8d20-49e1fb211b30 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.641332 Oct 04 12:05:21.700783 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 118/226] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:21 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:21.848629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e2f930b2-6ccc-4a61-b756-2bbeeb3d6c32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:21.849257 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e2f930b2-6ccc-4a61-b756-2bbeeb3d6c32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:21.852772 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:22.005272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:22.020191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-77c82e82-ef66-4d4f-9831-bba69611e07a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1699 microversion: 2.1 time: 0.831859 Oct 04 12:05:22.025015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 109/227] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:21 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1699 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:22.041933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-ea21444c-78a3-4842-b5bc-b84780a62443 req-7fd83f0f-2a0b-45ec-ae1f-faf98d0d43bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76f7c746-e3e0-4a7c-a2ed-0bc2431259a4", "tag": "b918f747-23c0-4e2b-9869-4625f94917c3"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:22.053570 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e2f930b2-6ccc-4a61-b756-2bbeeb3d6c32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:22.064527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ea21444c-78a3-4842-b5bc-b84780a62443 req-7fd83f0f-2a0b-45ec-ae1f-faf98d0d43bd service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.065418 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e2f930b2-6ccc-4a61-b756-2bbeeb3d6c32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1242 microversion: 2.1 time: 0.222017 Oct 04 12:05:22.068067 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 119/228] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:21 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1242 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:22.076269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ea21444c-78a3-4842-b5bc-b84780a62443 req-7fd83f0f-2a0b-45ec-ae1f-faf98d0d43bd service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.076742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ea21444c-78a3-4842-b5bc-b84780a62443 req-7fd83f0f-2a0b-45ec-ae1f-faf98d0d43bd service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.082354 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:22.084320 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:22.102437 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.102743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-ea21444c-78a3-4842-b5bc-b84780a62443 req-7fd83f0f-2a0b-45ec-ae1f-faf98d0d43bd service nova] Creating event network-changed:b918f747-23c0-4e2b-9869-4625f94917c3 for instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 on hv-cinder-86021 Oct 04 12:05:22.102942 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.103591 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.104705 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.105386 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.107740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.112752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-ea21444c-78a3-4842-b5bc-b84780a62443 req-7fd83f0f-2a0b-45ec-ae1f-faf98d0d43bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086105 Oct 04 12:05:22.116399 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 110/229] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:22.118557 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:22.140414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-09ae529b-4f66-47bc-8c8c-088383b5bb51 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:22.158339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09ae529b-4f66-47bc-8c8c-088383b5bb51 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.158848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09ae529b-4f66-47bc-8c8c-088383b5bb51 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.159297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09ae529b-4f66-47bc-8c8c-088383b5bb51 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.318744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-09ae529b-4f66-47bc-8c8c-088383b5bb51 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Going to try to start instance {{(pid=133083) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 12:05:22.368628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:22.415364 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:22.424514 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-047af15b-048e-4c9d-b2cb-0d50b3987a1a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.354918 Oct 04 12:05:22.425112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 120/230] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:22 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:22.688213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-09ae529b-4f66-47bc-8c8c-088383b5bb51 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action" status: 202 len: 0 microversion: 2.1 time: 0.569956 Oct 04 12:05:22.694935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 111/231] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:05:22 2022] POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:05:22.711171 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:22.712015 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:22.757602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:22.758456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:22.762409 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.762945 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.763393 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.764142 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.764640 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.768727 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.776922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.777424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.777862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:22.779109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:22.788987 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:22.789866 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:23.392365 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:23.440052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-c3b52d84-6df3-4c81-a345-9a957d72a637 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1708 microversion: 2.1 time: 0.741098 Oct 04 12:05:23.452438 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 121/232] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:22 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1708 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:23.464864 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:23.467114 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:23.490218 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:23.497823 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:23.500510 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:23.504438 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:23.506691 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:23.507835 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:23.739370 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:23.761665 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-11d88d97-5f98-41a9-963c-6899b65bd477 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1238 microversion: 2.1 time: 0.305482 Oct 04 12:05:23.763191 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 122/233] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:23 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1238 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:23.776865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:23.781968 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:23.827414 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:23.829068 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:23.831153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:23.833130 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:23.833984 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:23.835036 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:24.423658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:24.438035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b4ab9e2c-275b-4c21-a267-7e1b3a08a2c5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 1.701702 Oct 04 12:05:24.439178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 112/234] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:22 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:24.475999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:24.477030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:24.500241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:24.502405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:24.504687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:24.506910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:24.508128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:24.509254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:24.826202 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:24.849190 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a8713aa7-ef8d-4d64-b331-21a3cd10a002 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 1.083790 Oct 04 12:05:24.880945 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 123/235] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:23 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:24.914943 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:24.916062 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:24.966822 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:24.967328 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:24.967774 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:24.968543 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:24.969005 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:24.969436 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:25.225038 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:25.253513 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-faa77f0f-10d6-4451-8bcc-c4814a0920df tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1294 microversion: 2.1 time: 0.369423 Oct 04 12:05:25.269929 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 124/236] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:24 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1294 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:25.486634 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:25.487271 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:25.507076 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:25.508359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:25.513957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:25.518316 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:25.523055 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:25.523055 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:25.682180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:25.733036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-482aecbd-907a-4449-808c-2932fd5b4d2c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1708 microversion: 2.1 time: 1.258363 Oct 04 12:05:25.737515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 113/237] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:24 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1708 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:25.925467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:25.926841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:25.964697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:25.968606 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:25.973442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:25.974986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:25.983658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:25.985139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:26.084495 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:26.084495 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-cc3d9c76-d79d-4fde-bf36-253c021e46a4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.599033 Oct 04 12:05:26.084495 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 125/238] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:25 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:26.302740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:26.302909 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:26.317646 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:26.324447 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:26.327912 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:26.333128 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:26.339487 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:26.342180 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:26.807014 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:26.807014 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-291b06b7-325b-4e7f-9d78-baa642d5b638 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1302 microversion: 2.1 time: 0.478874 Oct 04 12:05:26.807014 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 126/239] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:26 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1302 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:26.807014 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:26.807873 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:26.809945 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:26.813448 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:26.814850 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:26.819414 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:26.819916 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:26.822706 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:26.925111 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:26.934577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-13692c6b-3c24-45d3-9b44-15838d706575 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 1.017580 Oct 04 12:05:26.946467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 114/240] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:25 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:27.109461 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:27.110706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:27.114034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:27.143802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:27.145196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:27.146667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:27.149148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:27.150058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:27.150718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:27.659143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:27.674717 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a23701b8-2055-42d5-8737-35d1499f28dc tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.570400 Oct 04 12:05:27.674717 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 115/241] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:27 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:27.869643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:27.869643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:27.888953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:27.889763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:27.890364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:27.897887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:27.898673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:27.910501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:28.461166 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:28.517927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-16c468e1-6bc5-4298-9327-ba8956143762 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1708 microversion: 2.1 time: 1.733823 Oct 04 12:05:28.524914 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 127/242] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:26 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1708 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:28.590501 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:28.598890 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:28.627531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:28.631108 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:28.631776 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:28.634670 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:28.636709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:28.638184 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:28.928929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:28.945673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-901d6b1c-965c-4a16-a652-d7473261ea32 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1300 microversion: 2.1 time: 1.081942 Oct 04 12:05:28.946774 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 116/243] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:27 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1300 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:28.989418 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=2 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:29.592497 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:29.609461 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5703d00f-6045-444f-b9ed-b4e6b25039ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 1.081090 Oct 04 12:05:29.611875 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 128/244] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:28 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:29.619557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4b43301c-cc50-4585-a954-175bff61ec2e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Action: 'create', calling method: .version_select at 0x7f10c38cf4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-25342910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvqda1naAoJ1rJq4vOWcoOivjreaRpmZyqDbx6HemJ1+EzGv9cleTyh2hB7m/PlRthpnTWtCHmsONr5PBMCZx3msFg2Uffgwn/rsx2bwXP7Ftu251IFJU6rZtwC5vOLIA=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:29.631958 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:29.650541 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:29.681155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-4b43301c-cc50-4585-a954-175bff61ec2e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for project d4da0e2bff704d7a944445d0011a8667. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:29.685203 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:29.685917 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:29.686378 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:29.687151 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:29.687631 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:29.688071 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:29.704946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-4b43301c-cc50-4585-a954-175bff61ec2e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for user 76771369a0df4c5189e42291ebdf9d24 and project d4da0e2bff704d7a944445d0011a8667. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:29.862294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4b43301c-cc50-4585-a954-175bff61ec2e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.913917 Oct 04 12:05:29.874593 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 117/245] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:05:28 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:29.905108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:29.911016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:29.950125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:29.959638 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:29.964056 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:29.976930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:29.987259 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:29.988133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:30.682628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:30.700956 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5e547370-be51-4891-867c-a949e6c61301 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 1.072652 Oct 04 12:05:30.709582 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 129/246] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:29 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:30.720595 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:30.724252 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:30.738280 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:30.739885 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:30.740623 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:30.743546 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:30.744424 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:30.746990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:30.833691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:30.870734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3100eda4-4aff-4750-b679-d64665910956 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1712 microversion: 2.1 time: 0.992184 Oct 04 12:05:30.873534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 118/247] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:29 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1712 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:30.899663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:30.901595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:30.916515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:30.931423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:30.933876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:30.936828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:30.940424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:30.940424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:31.957506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:31.986198 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6846c745-56c6-46ae-b5cd-c081f21b5661 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 1.110824 Oct 04 12:05:31.992982 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 119/248] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:30 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:31.994713 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:32.011259 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:32.015584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:32.022523 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-529960ec-f27c-444d-a399-91830aab12e8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 1.309237 Oct 04 12:05:32.027562 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 130/249] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:30 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:32.050551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:32.051790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:32.054509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:32.057633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:32.060794 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:32.061776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:32.946251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:33.015883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4d3f5c71-3c1f-4524-ba2f-ad2d052e1163 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 1.018604 Oct 04 12:05:33.045184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 120/250] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:31 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:33.052063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:33.057877 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:33.059598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:33.078180 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:33.098842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:33.100204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:33.107867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:33.108212 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=20 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:33.109684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:33.111202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:33.111458 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:33.112281 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:33.114802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:33.136517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:33.136517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:33.136517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:33.136517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:33.951639 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:33.975122 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9767ad26-e287-4e65-84da-c26a943789e1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.928129 Oct 04 12:05:34.003308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 121/251] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:33 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:34.084389 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:34.085507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:34.115075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:34.124726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:34.126185 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:34.138618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:34.140139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:34.141218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:34.486669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:34.490301 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:34.517735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7b910c98-b17d-456b-8dfe-4c81fcfc10ad tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.441657 Oct 04 12:05:34.520531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 122/252] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:34 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:34.528525 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f5512a03-15a9-403c-b83d-681581be423d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 1.486567 Oct 04 12:05:34.538154 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 131/253] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:33 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:35.031164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:35.037251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:35.073767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.076733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.077786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:35.080721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.082071 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.083350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:35.523859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:35.536563 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2ea2815f-a8f7-4456-9273-403b9d41d71b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.514457 Oct 04 12:05:35.537903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 123/254] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:35 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:35.569353 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:35.570490 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:35.604842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:35.606882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:35.615512 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.616493 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.617189 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:35.618368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.618657 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.618996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.619460 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.619603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:35.620207 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:35.620609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:35.621993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:35.622773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:35.852120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:35.863801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e9023809-6f46-4535-aaa7-06bd9420aedd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.276021 Oct 04 12:05:35.865642 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 124/255] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:35 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:36.068690 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:36.088457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6cb06297-4b9c-4aa5-9923-d1e72964b6ea tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.526544 Oct 04 12:05:36.089173 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 132/256] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:35 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:36.537176 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-df23d878-7dce-45ae-82c4-15ae9a9126ad req-2d34f534-779b-4b09-8835-6a507a5e8a7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd8bd8a-3940-41fa-9d04-8d64e5932dff", "tag": "d14fe48b-a81b-4523-a16a-7bc4020e7d73"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:36.552571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-df23d878-7dce-45ae-82c4-15ae9a9126ad req-2d34f534-779b-4b09-8835-6a507a5e8a7a service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:36.553237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-df23d878-7dce-45ae-82c4-15ae9a9126ad req-2d34f534-779b-4b09-8835-6a507a5e8a7a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:36.553764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-df23d878-7dce-45ae-82c4-15ae9a9126ad req-2d34f534-779b-4b09-8835-6a507a5e8a7a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:36.585332 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:36.586086 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:36.595544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-df23d878-7dce-45ae-82c4-15ae9a9126ad req-2d34f534-779b-4b09-8835-6a507a5e8a7a service nova] Creating event network-changed:d14fe48b-a81b-4523-a16a-7bc4020e7d73 for instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff on hv-cinder-86021 Oct 04 12:05:36.596117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:36.597464 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:36.600094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:36.602930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:36.604919 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:36.607028 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:36.608451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-df23d878-7dce-45ae-82c4-15ae9a9126ad req-2d34f534-779b-4b09-8835-6a507a5e8a7a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075637 Oct 04 12:05:36.613134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 125/257] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:05:36.906687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:36.909507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:36.919481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:36.948913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:36.948913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:36.948913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:36.948913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:36.949393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:36.990128 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:37.033142 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-1040834a-98b0-4c75-87e9-dd75fd7fe1ee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.445902 Oct 04 12:05:37.034586 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 133/258] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:36 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:37.103917 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-adadcb75-1757-4b51-91b4-4cadb89b3d80 req-0b859805-cc1e-4c17-8d21-4bf8f5b802d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f7c746-e3e0-4a7c-a2ed-0bc2431259a4", "name": "network-vif-plugged", "status": "completed", "tag": "b918f747-23c0-4e2b-9869-4625f94917c3"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:37.118000 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-adadcb75-1757-4b51-91b4-4cadb89b3d80 req-0b859805-cc1e-4c17-8d21-4bf8f5b802d0 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:37.118752 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-adadcb75-1757-4b51-91b4-4cadb89b3d80 req-0b859805-cc1e-4c17-8d21-4bf8f5b802d0 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:37.119481 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-adadcb75-1757-4b51-91b4-4cadb89b3d80 req-0b859805-cc1e-4c17-8d21-4bf8f5b802d0 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:37.138563 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-adadcb75-1757-4b51-91b4-4cadb89b3d80 req-0b859805-cc1e-4c17-8d21-4bf8f5b802d0 service nova] Creating event network-vif-plugged:b918f747-23c0-4e2b-9869-4625f94917c3 for instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 on hv-cinder-86021 Oct 04 12:05:37.157640 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-adadcb75-1757-4b51-91b4-4cadb89b3d80 req-0b859805-cc1e-4c17-8d21-4bf8f5b802d0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058071 Oct 04 12:05:37.158944 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 134/259] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:05:37.166949 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:37.168208 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:37.218701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:37.220582 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:37.221151 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:37.222052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:37.222608 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:37.223164 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:37.227914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:37.254339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-08d16ce6-7c1f-441f-9d3c-7c96b408a6e1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1518 microversion: 2.1 time: 0.358043 Oct 04 12:05:37.265618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 126/260] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:36 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1518 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:37.531817 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:37.549353 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-85f3ce29-52b4-43b4-8864-16125b6b8fec tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.388839 Oct 04 12:05:37.552030 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 135/261] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:37 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:38.076091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.077095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:38.090549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.091048 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.091680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.092666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.093336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.093990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.278615 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.279475 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:38.291517 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.292019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.292548 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.293850 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.312339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.313302 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.401269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:38.418577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b802cda0-bf1d-4ee3-957a-ae6afb0abc42 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.346417 Oct 04 12:05:38.440207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 127/262] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:38.587408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.596761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:38.614407 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.616074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.617577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.619779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.620939 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.622911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.791296 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:38.812620 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-ea3ba60d-2f22-43dc-8b87-ffc3bfbcaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1498 microversion: 2.1 time: 0.537890 Oct 04 12:05:38.823159 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 136/263] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1498 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:38.883892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:38.890604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:38.907449 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.908463 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.909384 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.910571 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:38.912131 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:38.912769 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:38.944471 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=100 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:39.003878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:39.022016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-81451a3f-bda4-41de-8c89-9399997a41ab tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.445487 Oct 04 12:05:39.032210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 128/264] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:39.109269 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:39.150373 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-69234c00-131d-4f9b-8123-644f1d531d82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1515 microversion: 2.1 time: 0.293387 Oct 04 12:05:39.158415 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 137/265] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:38 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1515 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:39.456715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:39.457641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:39.471550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:39.474694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:39.475509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:39.476534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:39.477249 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:39.479736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:39.736203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=4 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:39.752958 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:39.755728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:39.764884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6f7b3b00-28db-4ea5-bb45-ef8b17ef773f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.312481 Oct 04 12:05:39.765959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 129/266] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:39 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:40.051547 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:40.051547 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:40.057938 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:40.063975 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:40.064626 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:40.065408 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:40.065889 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:40.066325 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:40.359463 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:40.372377 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b4e2c54a-ce43-4693-9205-efcb41fa2d4c tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1313 microversion: 2.1 time: 0.328233 Oct 04 12:05:40.376850 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 138/267] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:40 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:40.824901 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:40.827572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:40.843095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:40.844211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:40.845183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:40.846930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:40.848370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:40.849332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:41.049853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:41.058984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-50d09558-8beb-4f0a-9d4b-a5e33174a6a4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.262354 Oct 04 12:05:41.059466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 130/268] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:40 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:41.399413 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:41.400098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:41.406754 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:41.407249 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:41.407679 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:41.408404 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:41.408853 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:41.409314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:41.611303 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:41.620482 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-302c39e8-9772-40b0-8efa-79476b5800f4 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1498 microversion: 2.1 time: 0.227427 Oct 04 12:05:41.640701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 139/269] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:41 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1498 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:42.083882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:42.085241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:42.094413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:42.094886 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:42.095532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:42.096514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:42.096978 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:42.097403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:42.341955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:42.354934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e58430f2-f8ec-4795-9ed0-e0ec885f09ba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.276023 Oct 04 12:05:42.373096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 131/270] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:42 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:43.386390 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:43.387254 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:43.395604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:43.396806 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:43.397444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:43.398892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:43.399613 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:43.400559 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:43.633545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:43.641442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:43.658729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:43.659447 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:43.660752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:43.662148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:43.663191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:43.664319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:43.727833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lazy-loading 'flavor' on Instance uuid 87dbf236-4a32-4b65-b4b5-6e75f778f934 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:05:43.852427 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:43.877914 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6e3e6df5-ff4b-46f9-8dde-b98c70418891 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.494468 Oct 04 12:05:43.879997 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 140/271] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:43 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:43.893542 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:43.900153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:43.940624 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:43.943985 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:43.946865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:43.950760 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:43.952481 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:43.954901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:44.015450 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Going to try to terminate instance {{(pid=133084) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:05:44.462634 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-175cd722-ed05-4376-8cad-090108ac6fa0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934/action" status: 200 len: 32 microversion: 2.1 time: 0.842321 Oct 04 12:05:44.464014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 132/272] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:05:43 2022] POST /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934/action => generated 32 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:05:44.474959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:44.476019 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:44.484859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:44.485648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:44.486273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:44.487176 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:44.488861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:44.489546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:44.682721 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-2dc53f08-0869-450e-b650-3930782329ba tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "DELETE /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 204 len: 0 microversion: 2.1 time: 0.800063 Oct 04 12:05:44.688318 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 141/273] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:05:43 2022] DELETE /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:05:44.710334 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:44.718319 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:44.732654 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:44.733254 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:44.733588 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:44.737485 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:44.737485 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:44.737485 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:44.818603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:44.842280 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6cb9ba83-0f20-4d1c-9d9b-f3ebfeb46474 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.371332 Oct 04 12:05:44.844264 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 133/274] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:44 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:44.957749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:44.959496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:44.978591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:44.979910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:44.981138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:44.982832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:44.984047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:44.985178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:45.022927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:45.043634 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-198a920b-40be-4de5-9fdf-33a370bf99e7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1504 microversion: 2.1 time: 0.341917 Oct 04 12:05:45.046370 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 142/275] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:44 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:45.298938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:45.362524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-33969d3c-19fd-45c8-9bcb-e2507b5cc075 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.387615 Oct 04 12:05:45.362524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 134/276] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:44 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:45.902253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:45.902951 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:45.912701 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:45.913260 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:45.913901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:45.915077 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:45.915571 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:45.916042 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:46.068495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:46.069641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:46.083630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:46.084534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:46.085253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:46.086525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:46.087531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:46.088387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:46.094059 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:46.115712 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-76e13c0e-45e8-4819-b708-f7a0b5e98e42 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.217205 Oct 04 12:05:46.116911 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 143/277] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:45 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:46.272925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:46.282052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cfa8fe97-5fb5-4bcb-a7ec-9b409d330baf tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1504 microversion: 2.1 time: 0.218256 Oct 04 12:05:46.282742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 135/278] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:46 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:46.366413 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:46.367098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:46.373788 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:46.374278 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:46.374981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:46.375804 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:46.376301 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:46.376730 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:46.566438 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:46.580152 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6cf3ea33-7c12-4fad-b9a2-fb16213aaba4 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.217560 Oct 04 12:05:46.592768 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 144/279] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:46 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:47.145268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:47.145995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:47.155164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:47.155673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:47.156122 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:47.156898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:47.157359 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:47.157780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:47.311379 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:47.311983 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:47.322163 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:47.323040 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:47.324393 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:47.325714 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:47.326416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:47.327136 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:47.387256 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:47.407647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9be2a41f-3ca4-4982-93c5-d32bbc551e71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.265885 Oct 04 12:05:47.428920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 136/280] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:47 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:47.628724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:47.628724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:47.641097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:47.642146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:47.643147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:47.644972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:47.646147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:47.647621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:47.952633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:47.958431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9e5dc44e-7ca4-4034-8fb5-c7dd7a94be65 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.346888 Oct 04 12:05:47.959439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 137/281] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:47 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:47.964623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-7025b994-9128-4705-b732-810f5ce4cdcf req-fec92295-1731-42b0-88b1-d67d6faae66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd8bd8a-3940-41fa-9d04-8d64e5932dff", "name": "network-vif-plugged", "status": "completed", "tag": "d14fe48b-a81b-4523-a16a-7bc4020e7d73"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:47.976031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7025b994-9128-4705-b732-810f5ce4cdcf req-fec92295-1731-42b0-88b1-d67d6faae66e service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:47.977025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7025b994-9128-4705-b732-810f5ce4cdcf req-fec92295-1731-42b0-88b1-d67d6faae66e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:47.977652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7025b994-9128-4705-b732-810f5ce4cdcf req-fec92295-1731-42b0-88b1-d67d6faae66e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:48.001438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-7025b994-9128-4705-b732-810f5ce4cdcf req-fec92295-1731-42b0-88b1-d67d6faae66e service nova] Creating event network-vif-plugged:d14fe48b-a81b-4523-a16a-7bc4020e7d73 for instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff on hv-cinder-86021 Oct 04 12:05:48.017088 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-7025b994-9128-4705-b732-810f5ce4cdcf req-fec92295-1731-42b0-88b1-d67d6faae66e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055629 Oct 04 12:05:48.019099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 138/282] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:48.066288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-74f532e8-4f2c-4e3b-935a-4b97340678e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Action: 'create', calling method: .version_select at 0x7f10c3a2c3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-808896546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAazUbWRTAkY+Zwg1aNSWD8dzz96tWYD/1PyLGFL242aeTgZhTEyaow32HCNIiwRhlG/zVPMDReKjX3j4f40TzhFUyGlswqhCf1mJD9RB9BR3+xATuFI5Sn5qaGiLY54Bg=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:48.084059 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-74f532e8-4f2c-4e3b-935a-4b97340678e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Getting quotas for project 950b28fc6faf434482bbb1c2db3fa194. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:48.088848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-74f532e8-4f2c-4e3b-935a-4b97340678e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Getting quotas for user 2b8dc16b63584a46b9f63b52aa5ce391 and project 950b28fc6faf434482bbb1c2db3fa194. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:48.216032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-74f532e8-4f2c-4e3b-935a-4b97340678e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.154076 Oct 04 12:05:48.217270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 139/283] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:05:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:05:48.236590 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:48.250709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f877c2f9-27a7-4044-94d7-3b002dba9df5 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1504 microversion: 2.1 time: 0.943169 Oct 04 12:05:48.251779 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 145/284] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:47 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1504 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:48.408324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1233066394", "imageRef": "8ced4fd0-01b5-4f2a-8a29-e9087fbe205f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-808896546", "networks": [{"uuid": "7612eebe-4d27-43c7-8708-b2bfb7ea64e6"}]}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:48.438507 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:48.439155 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:48.451895 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:48.453041 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:48.459090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:48.459090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:48.459090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:48.459090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:48.470230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] validate_networks() for [('7612eebe-4d27-43c7-8708-b2bfb7ea64e6', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:05:48.692670 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:48.702702 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b6c66273-bdf3-45e7-a1bd-ca86772c7dfc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.268069 Oct 04 12:05:48.706931 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 146/285] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:48 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:48.997917 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:48.998869 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:49.006133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.006834 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.007428 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.008342 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.008993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.009923 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.113657 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:05:49.115073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:05:49.115986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:05:49.117157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:05:49.117937 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:05:49.135390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.136278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.137063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.138455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.139186 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.139927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.176778 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Getting quotas for project 950b28fc6faf434482bbb1c2db3fa194. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:05:49.183015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Getting quotas for user 2b8dc16b63584a46b9f63b52aa5ce391 and project 950b28fc6faf434482bbb1c2db3fa194. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:05:49.196627 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:49.202675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:05:49.207114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8ced4fd0-01b5-4f2a-8a29-e9087fbe205f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:05:49.212303 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-73807cfd-a093-4ec4-b72e-7d504c0dc062 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.220613 Oct 04 12:05:49.213358 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 147/286] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:48 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:49.224335 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-f9c07f80-fe45-4a32-9ceb-b06b231d100b req-b70c0e7a-ef8f-4e1e-81c4-3f6547e62d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76f7c746-e3e0-4a7c-a2ed-0bc2431259a4", "name": "network-vif-deleted", "tag": "b918f747-23c0-4e2b-9869-4625f94917c3"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:49.241588 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f9c07f80-fe45-4a32-9ceb-b06b231d100b req-b70c0e7a-ef8f-4e1e-81c4-3f6547e62d9c service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.242363 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f9c07f80-fe45-4a32-9ceb-b06b231d100b req-b70c0e7a-ef8f-4e1e-81c4-3f6547e62d9c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.243065 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f9c07f80-fe45-4a32-9ceb-b06b231d100b req-b70c0e7a-ef8f-4e1e-81c4-3f6547e62d9c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.263675 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-f9c07f80-fe45-4a32-9ceb-b06b231d100b req-b70c0e7a-ef8f-4e1e-81c4-3f6547e62d9c service nova] Creating event network-vif-deleted:b918f747-23c0-4e2b-9869-4625f94917c3 for instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 on hv-cinder-86021 Oct 04 12:05:49.269032 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-f9c07f80-fe45-4a32-9ceb-b06b231d100b req-b70c0e7a-ef8f-4e1e-81c4-3f6547e62d9c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054018 Oct 04 12:05:49.269770 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 148/287] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:05:49.278034 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:49.278953 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:49.287088 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.287332 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.287781 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.288538 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.288990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.289434 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.367567 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:49.383737 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-c6ef3707-b326-464c-837b-19910fbb32f9 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1462 microversion: 2.1 time: 0.111898 Oct 04 12:05:49.384565 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 149/288] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:49 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1462 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:49.400853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ded9fbe4-10bd-469a-9910-b2a8ef88106f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996164 Oct 04 12:05:49.403498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 140/289] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:05:49.420865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-55b35bfe-aed3-4759-9530-c9eb524bab62 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:49.422336 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-55b35bfe-aed3-4759-9530-c9eb524bab62 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:49.507618 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-55b35bfe-aed3-4759-9530-c9eb524bab62 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:49.522025 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-55b35bfe-aed3-4759-9530-c9eb524bab62 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1258 microversion: 2.1 time: 0.104813 Oct 04 12:05:49.523017 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 150/290] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:49 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1258 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:49.740116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:49.741511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:49.747741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.748273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.748706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.749415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:49.749871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:49.750299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:49.905170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:49.914126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cd3b9604-d47d-41fd-a5e0-4a05c3d584db tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.178274 Oct 04 12:05:49.918967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 141/291] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:49 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:50.248823 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:50.249858 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:50.258611 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:50.259108 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:50.259553 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:50.260322 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:50.260782 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:50.261256 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:50.418121 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:50.419289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:50.432060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:50.433051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:50.433831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:50.435103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:50.435931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:50.436740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:50.440867 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:50.454228 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-176664fd-2034-4985-90dc-9f5c77a4a777 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.214274 Oct 04 12:05:50.455109 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 151/292] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:50 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:50.516676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:50.525262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-307cbb7b-8d21-4127-8ab1-03acda391a89 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1462 microversion: 2.1 time: 0.114612 Oct 04 12:05:50.525868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 142/293] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:50 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1462 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:50.555475 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e5c17578-a135-403f-897c-2c4b54dc38b2 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:50.556109 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e5c17578-a135-403f-897c-2c4b54dc38b2 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:50.629570 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e5c17578-a135-403f-897c-2c4b54dc38b2 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:50.638585 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e5c17578-a135-403f-897c-2c4b54dc38b2 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1258 microversion: 2.1 time: 0.088112 Oct 04 12:05:50.639361 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 152/294] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:50 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:50.940727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:50.941375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:50.947586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:50.948086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:50.948532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:50.957336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:50.957336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:50.957336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:51.146659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:51.152307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b1de3663-34e1-4fa5-89c5-c4cde1ecaad1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.216029 Oct 04 12:05:51.153053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 143/295] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:50 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:51.481226 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:51.481865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:51.490129 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:51.490629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:51.491071 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:51.491805 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:51.492313 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:51.492738 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:51.549997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:51.550954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:51.559740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:51.560450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:51.560980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:51.561829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:51.562359 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:51.562853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:51.681177 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:51.688636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:51.699222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-2385192b-bb60-4bc5-a371-ab8e39aa7798 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.221849 Oct 04 12:05:51.707474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 153/296] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:51 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:51.712443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e82b8158-5483-4322-b3f5-07be0734bbe2 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1462 microversion: 2.1 time: 0.166118 Oct 04 12:05:51.713497 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:51.714195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 144/297] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:51 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1462 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:51.717955 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:51.732469 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:51.733715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:51.734765 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:51.736740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:51.737684 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:51.738477 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:51.836618 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:51.845424 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-8b9eea50-019a-46b5-bebf-8c47f7ac66b7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1262 microversion: 2.1 time: 0.142687 Oct 04 12:05:51.846381 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 154/298] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:51 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1262 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:52.178293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:52.178945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:52.185959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.187164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.187164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.187714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.188213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.188573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.373673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:52.382878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c58ba986-e069-4000-831b-d9b1f4f20176 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.209532 Oct 04 12:05:52.383469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 145/299] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:52 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:52.729439 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:52.731276 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:52.738000 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.738488 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.738632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:52.739368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:52.739562 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.740361 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.740820 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.741225 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.747392 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:52.748982 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.750010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.750639 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.751561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.752309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.752739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.784631 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:52.790261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.790844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.791279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.791734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lazy-loading 'fault' on Instance uuid 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:05:52.795976 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:52.859232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:52.871966 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b9a0ef72-72a1-4ee2-bade-ad85369dfec3 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1303 microversion: 2.1 time: 0.137784 Oct 04 12:05:52.879780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 146/300] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:52 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:52.880513 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:52.881344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:52.895428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.896313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.897217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.898898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:52.899732 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:52.900538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:52.931097 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:52.939600 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-400a1429-8c06-4e82-9f74-33846537910b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.214530 Oct 04 12:05:52.940080 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 155/301] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:52 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:52.985748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:52.995353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e1e94a39-16c7-4f54-a0f2-9b782b4d9a27 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1254 microversion: 2.1 time: 0.120713 Oct 04 12:05:52.996196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 147/302] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:52 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1254 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:53.410622 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:53.410622 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:53.418367 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.418867 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.419309 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.420037 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.420537 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.421114 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.581576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:53.590203 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-62c7c56a-2e0e-410b-9c7c-73ba2c25c43b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.186928 Oct 04 12:05:53.590799 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 156/303] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:53 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:53.896668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:53.897489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:53.906167 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.906711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.907150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.907863 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.908355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.908788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.952091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.952619 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.953282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.954016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lazy-loading 'fault' on Instance uuid 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:05:53.982699 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:53.983949 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:53.995084 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.996551 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:53.997153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:53.998611 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:53.999489 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:54.000949 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:54.028903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:54.043199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ff5f594e-a8ab-46d8-a841-496b39f0526e tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1303 microversion: 2.1 time: 0.149691 Oct 04 12:05:54.044783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 148/304] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:53 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:54.053703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:54.054661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:54.065947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:54.067098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:54.068073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:54.069359 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:54.070585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:54.071557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:54.162235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:54.172761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-390f8627-f14b-4230-8c47-2927eb84d410 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1254 microversion: 2.1 time: 0.126062 Oct 04 12:05:54.173357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 149/305] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:54 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1254 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:54.323236 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:54.337022 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-26003ccc-5df5-4e90-a06a-ec805a461ad1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.360477 Oct 04 12:05:54.337956 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 157/306] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:53 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:54.616426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:54.617048 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:54.625735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:54.626232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:54.626654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:54.627626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:54.628087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:54.631875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:54.879005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:54.895865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-26ad3d15-10ec-431b-9017-da44b696083f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.283551 Oct 04 12:05:54.897505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 150/307] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:54 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:55.072925 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:55.074693 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:55.088089 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.089034 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.090992 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.092491 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.103610 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.103610 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.146104 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.146545 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.147005 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.147492 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.objects.instance [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lazy-loading 'fault' on Instance uuid 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 {{(pid=133084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:05:55.199713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:55.200872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:55.209536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.210842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.211475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.212227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.212681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.213102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.213299 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6a9052a75a4d8c9f4a08638685012b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df93e841cba9441f84c15a826db25de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:55.225272 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-ac4e1093-2ad0-4f9f-9f8b-6ee9bad04fac tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 200 len: 1303 microversion: 2.1 time: 0.159542 Oct 04 12:05:55.226384 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 158/308] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:55 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:55.284105 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:55.292984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7ee2bd86-d401-4d8a-ad9f-ee3253385443 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1310 microversion: 2.1 time: 0.099324 Oct 04 12:05:55.293577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 151/309] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:55 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:55.362043 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:55.362864 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:55.369916 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.370934 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.371368 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.372075 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.372725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.373344 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.579751 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:55.588018 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-dbc2f32e-1356-4d98-9950-fa928ee2cb44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1367 microversion: 2.1 time: 0.230684 Oct 04 12:05:55.588655 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 159/310] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:55 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:55.923822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:55.924499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:55.932466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.933540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.934037 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:55.934801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:55.935270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:55.935703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.148548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:56.162601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-098bc500-8aab-4863-8b59-59cf4bff319f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.242210 Oct 04 12:05:56.162601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 152/311] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:55 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:56.263913 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:56.264618 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] [instance: 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:56.271675 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.272205 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.272630 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.273347 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.273797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.274217 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.wsgi [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] HTTP exception thrown: Instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 could not be found. Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Request method failure captured: Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: request: GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 HTTP/1.1 Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept: application/json Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept-Encoding: identity Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Connection: close Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Length: 0 Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Type: application/json Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Host: 10.222.0.15 Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Openstack-System-Scope: None Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: User-Agent: python-urllib3/1.26.12 Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Auth-Token: gAAAAABjPCFAouycuriYsav_coo48j_fRJEfNcNEuzaOz9289Wfp2A78kl2oAjHHtij5G-Z_1g_NjS9XT5jivmj0TEceqnBvpCh6ZMV7UluY0f4yRO2AiImPV4MfRo1xNVU_m6ltEp_bPwyFMt-wSh6sU6ji9hwXjiQwFD4p8ZoRgzCALGUS1ho Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Id: None Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Name: None Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Identity-Status: Confirmed Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Is-Admin-Project: True Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Id: default Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Name: Default Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Id: df93e841cba9441f84c15a826db25de6 Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Name: tempest-VolumesActionsTest-617245700 Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Role: reader,member Oct 04 12:05:56.294766 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Roles: reader,member Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_df93e841cba9441f84c15a826db25de6", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/df93e841cba9441f84c15a826db25de6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/df93e841cba9441f84c15a826db25de6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/df93e841cba9441f84c15a826db25de6"}]}] Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant: tempest-VolumesActionsTest-617245700 Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Id: df93e841cba9441f84c15a826db25de6 Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Name: tempest-VolumesActionsTest-617245700 Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User: tempest-VolumesActionsTest-617245700-project Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Id: default Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Name: Default Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Id: ee6a9052a75a4d8c9f4a08638685012b Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Name: tempest-VolumesActionsTest-617245700-project Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: method: > Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: exception: Instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 could not be found. Oct 04 12:05:56.296531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: action_args: {'id': '76f7c746-e3e0-4a7c-a2ed-0bc2431259a4'} Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 could not be found. Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:05:56.297416 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 could not be found. Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 could not be found. Oct 04 12:05:56.298928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:05:56.300220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] Returning 404 to user: Instance 76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 could not be found. {{(pid=133084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:05:56.300220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-4bcf6c71-6996-4d17-94b5-eb125f7e1cb7 tempest-VolumesActionsTest-617245700 tempest-VolumesActionsTest-617245700-project] 10.222.0.15 "GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4" status: 404 len: 111 microversion: 2.1 time: 0.034685 Oct 04 12:05:56.300220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 160/312] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:56 2022] GET /compute/v2.1/servers/76f7c746-e3e0-4a7c-a2ed-0bc2431259a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:05:56.331992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:56.332913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:56.341826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.342394 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.342837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.343565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.344025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.344592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.423061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:56.433527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-396c5b3e-d919-46d5-96e1-fd177ec0c0d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1310 microversion: 2.1 time: 0.105500 Oct 04 12:05:56.434246 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 153/313] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:56 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:56.611629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:56.612261 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:56.618528 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.619003 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.619427 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.620117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.620793 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.621226 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.805818 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:56.814555 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-4ef8f3d8-bf6f-4074-be9e-29d0caf1aff1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1557 microversion: 2.1 time: 0.206334 Oct 04 12:05:56.815161 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 161/314] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:56 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1557 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:56.857149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:56.857149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:56.861335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.861836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.862275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.863028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:56.863480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:56.863918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:56.952393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-dce8d58e-1347-4e6c-962d-fdea3db90847 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103392 Oct 04 12:05:56.953128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 154/315] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:05:56 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:05:57.187935 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:57.188596 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:57.193285 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:57.197749 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:57.198605 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:57.199317 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:57.200092 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:57.200948 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:57.201590 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:57.410828 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:57.444448 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6d3a3ecc-ed79-4a43-a9ba-3e3872a458bd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.255167 Oct 04 12:05:57.446820 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 162/316] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:57 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:57.463068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:57.468862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:57.484384 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:57.485027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:57.485548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:57.486456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:57.486805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:57.487250 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:57.611507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:57.636089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-664aa243-a577-4a11-9e76-e05c6e3d5036 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1328 microversion: 2.1 time: 0.179779 Oct 04 12:05:57.638012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 155/317] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:57 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:58.491781 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:58.496614 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:58.509483 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:58.510263 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:58.511578 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:58.512789 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:58.513864 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:58.514499 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:58.663775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:05:58.665295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:05:58.680015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:58.686789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:58.687529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:58.701289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:58.701907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:58.703470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:59.031237 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:59.048903 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-70516c38-1b5d-45e7-987f-3a5de14819b7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.562225 Oct 04 12:05:59.064157 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 163/318] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:58 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:05:59.154301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:59.192979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=10 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:05:59.292485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:05:59.311281 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f00231b9-b117-4ada-a740-373ad6512099 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.651667 Oct 04 12:05:59.326230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 156/319] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:05:58 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:05:59.342228 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-669e3afc-4dea-49b4-828c-b5301fac7583 req-745958c1-f30a-412e-af10-c4090ead4dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd8bd8a-3940-41fa-9d04-8d64e5932dff", "tag": "d14fe48b-a81b-4523-a16a-7bc4020e7d73"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:05:59.357077 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-669e3afc-4dea-49b4-828c-b5301fac7583 req-745958c1-f30a-412e-af10-c4090ead4dd7 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:05:59.358051 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-669e3afc-4dea-49b4-828c-b5301fac7583 req-745958c1-f30a-412e-af10-c4090ead4dd7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:05:59.358666 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-669e3afc-4dea-49b4-828c-b5301fac7583 req-745958c1-f30a-412e-af10-c4090ead4dd7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:05:59.375602 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-669e3afc-4dea-49b4-828c-b5301fac7583 req-745958c1-f30a-412e-af10-c4090ead4dd7 service nova] Creating event network-changed:d14fe48b-a81b-4523-a16a-7bc4020e7d73 for instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff on hv-cinder-86021 Oct 04 12:05:59.382696 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-669e3afc-4dea-49b4-828c-b5301fac7583 req-745958c1-f30a-412e-af10-c4090ead4dd7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044024 Oct 04 12:05:59.396244 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 164/320] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:00.102600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:00.104444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:00.151357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:00.161362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:00.161362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:00.161362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:00.161362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:00.162322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:00.225112 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-880ff020-a65a-4035-a708-af1096292843 req-4ceac762-3e43-478d-92f6-b62f020aae3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf295a22-6c0f-4895-9481-d51ee3d122b7", "tag": "44eb0f3a-3cfa-4d91-958a-358c9e234313"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:00.248979 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-880ff020-a65a-4035-a708-af1096292843 req-4ceac762-3e43-478d-92f6-b62f020aae3e service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:00.253750 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-880ff020-a65a-4035-a708-af1096292843 req-4ceac762-3e43-478d-92f6-b62f020aae3e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:00.253750 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-880ff020-a65a-4035-a708-af1096292843 req-4ceac762-3e43-478d-92f6-b62f020aae3e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:00.267848 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-880ff020-a65a-4035-a708-af1096292843 req-4ceac762-3e43-478d-92f6-b62f020aae3e service nova] Creating event network-changed:44eb0f3a-3cfa-4d91-958a-358c9e234313 for instance bf295a22-6c0f-4895-9481-d51ee3d122b7 on hv-cinder-86021 Oct 04 12:06:00.278836 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-880ff020-a65a-4035-a708-af1096292843 req-4ceac762-3e43-478d-92f6-b62f020aae3e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058445 Oct 04 12:06:00.280129 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 165/321] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:00.355650 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:00.356507 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:00.367731 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:00.378136 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:00.378948 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:00.379631 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:00.380107 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:00.386518 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:00.486181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:00.500350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d30d6f6f-5ee6-49ab-9bc2-4bd802329a87 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.407600 Oct 04 12:06:00.502322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 157/322] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:00 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:00.610868 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:00.623634 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-475c14e5-e510-40d4-b80b-12265dec10d6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.271800 Oct 04 12:06:00.640725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 166/323] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:00 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:01.532060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:01.532813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:01.542742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:01.543599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:01.544391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:01.545619 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:01.546433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:01.547177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:01.668051 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:01.670371 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:01.679059 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=4 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:01.683630 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:01.684917 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:01.685994 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:01.687578 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:01.688740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:01.695327 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:01.767454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:01.785022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d16c78cd-cdec-4c75-93ab-82f7a15b5763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.261834 Oct 04 12:06:01.787035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 158/324] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:01 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:01.943300 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:01.956603 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-50177177-9a1d-4eb9-88f0-57d25b0c0745 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.295760 Oct 04 12:06:01.957523 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 167/325] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:01 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:02.814813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:02.815984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:02.826930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:02.827761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:02.828563 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:02.829817 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:02.830667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:02.831439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:03.010216 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:03.011685 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:03.020220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:03.036242 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:03.036242 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:03.036242 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:03.036242 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:03.036948 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:03.085495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:03.095405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-46404ffd-f19c-4e9e-9fe6-7830abb66fd7 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.288020 Oct 04 12:06:03.096969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 159/326] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:02 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:03.280983 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:03.296475 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-23896cff-d2a7-4ed6-8c42-841f397957dd tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.300488 Oct 04 12:06:03.304396 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 168/327] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:02 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:04.137260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:04.138405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:04.150328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:04.162188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:04.162188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:04.162188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:04.162188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:04.163196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:04.327097 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:04.328046 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:04.336026 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:04.336720 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:04.337247 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:04.338084 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:04.339214 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:04.339737 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:04.355232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:04.366255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-efa0ce52-c8fb-4141-b52e-827d6d11d96a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.237093 Oct 04 12:06:04.367180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 160/328] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:04 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:04.544195 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:04.570469 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d2416e71-3617-4b25-bbdb-a81da939db4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.247032 Oct 04 12:06:04.571531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 169/329] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:04 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:05.403933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:05.404870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:05.411750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:05.412277 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:05.412716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:05.413450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:05.413918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:05.414343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:05.611823 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:05.614288 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:05.616981 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:05.628429 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:05.629708 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:05.630507 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:05.631791 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:05.632972 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:05.633948 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:05.635839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-97caae7b-be53-4512-897d-453c2cf1cc86 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.236379 Oct 04 12:06:05.636917 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 161/330] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:05 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:05.831456 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:05.841098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-845e5078-913b-46e4-a3e0-4191a7aaa740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.236716 Oct 04 12:06:05.841704 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 170/331] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:05 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:06.678840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:06.679691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:06.689892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:06.691341 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:06.691795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:06.692582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:06.693055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:06.693492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:06.876074 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:06.877567 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:06.890843 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:06.892379 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:06.893455 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:06.895078 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:06.896278 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:06.897290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:06.925736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:06.942224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6d8a6e34-3375-4f7a-9a20-2d1d9a448d03 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.266841 Oct 04 12:06:06.957073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 162/332] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:06 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:07.154860 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:07.170456 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-061976a0-b114-4b44-b5da-4e4d890f3822 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.306894 Oct 04 12:06:07.171459 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 171/333] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:06 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:07.985674 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:07.987525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:07.997604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:07.998269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:07.998882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:07.999793 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:08.000448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:08.001087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:08.007355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:08.232466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:08.232740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:08.232740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:08.233671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-14fabf4e-28de-4c07-a1ce-6f331ef69e35 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.238298 Oct 04 12:06:08.233827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:08.233977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 163/334] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:07 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:08.234135 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:08.234135 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:08.234135 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:08.234135 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:08.234657 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:08.445301 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:08.457648 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f2de1409-3ab9-4567-8506-cfd48b43405f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.255370 Oct 04 12:06:08.458470 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 172/335] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:08 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:09.267385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:09.268488 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:09.276438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:09.276935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:09.277377 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:09.278116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:09.278573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:09.279002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:09.457875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:09.470502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2069b8f1-cc80-4957-9843-6993b4d45caf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.210198 Oct 04 12:06:09.471549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 164/336] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:09 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:09.489457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:09.490593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:09.503655 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:09.504630 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:09.505424 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:09.506748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:09.507709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:09.508774 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:09.549068 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=100 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:09.729709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:09.738017 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-fb0a280c-af3d-4dec-b245-69188c20f6d8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.255699 Oct 04 12:06:09.738623 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 173/337] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:09 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:10.499437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:10.500462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:10.512463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:10.513325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:10.514080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:10.515322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:10.516120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:10.517068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:10.757077 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:10.769391 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:10.770729 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:10.774369 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4909a4ff-b803-4765-9e95-76410ae3dddc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.281935 Oct 04 12:06:10.777888 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:10.778743 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:10.779366 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:10.795188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 165/338] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:10 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:10.801386 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:10.802210 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:10.803030 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:11.019083 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:11.028978 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-bf3d1e45-f1e7-4626-8cdf-606c928375a4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.264199 Oct 04 12:06:11.039860 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 174/339] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:10 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:11.819499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:11.820436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:11.831769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:11.832332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:11.832797 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:11.833513 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:11.833970 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:11.834388 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:12.042986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:12.056042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3c0739ba-be3a-4553-a06b-5ee2ca2bd7ed tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.240283 Oct 04 12:06:12.057550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 166/340] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:11 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:12.066474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:12.067991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:12.075763 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:12.076948 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:12.077625 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:12.079406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:12.080056 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:12.081203 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:12.434203 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:12.462824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-8f08e44c-4bf4-4d9d-8c8d-ace3a8e70a3c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.412678 Oct 04 12:06:12.476447 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 175/341] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:12 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:13.091903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:13.093919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:13.102826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:13.104665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:13.105471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:13.106527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:13.107243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:13.107879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:13.508065 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:13.509818 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:13.520227 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:13.520721 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:13.521497 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:13.522504 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:13.523006 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:13.523548 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:13.709291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:13.726837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-000735e9-76f6-472a-9fb6-159c0d14d51e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.640153 Oct 04 12:06:13.728062 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 167/342] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:13 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:13.905642 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:13.918305 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e2c34205-aed7-4277-af98-f323672b5b52 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.416151 Oct 04 12:06:13.935821 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 176/343] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:13 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:14.775958 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:14.778350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:14.797641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:14.798864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:14.799424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:14.800313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:14.800969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:14.801567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:14.952135 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:14.954540 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:14.964452 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:14.965768 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:14.973670 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:14.975782 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:14.976907 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:14.977624 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:15.003624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:15.017769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a3942a69-263d-4892-a77c-bed4d2c4f295 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.251660 Oct 04 12:06:15.027816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 168/344] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:14 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:15.236200 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:15.245555 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-408e142e-e1e6-48ac-b767-6d5837297c8d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.299849 Oct 04 12:06:15.246153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 177/345] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:14 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:16.057982 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:16.058564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:16.065914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:16.066406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:16.067040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:16.067785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:16.068257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:16.068752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:16.270703 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:16.271812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:16.274196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:16.280350 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:16.281050 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:16.281598 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:16.282451 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:16.283021 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:16.283571 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:16.303703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-15250d3b-3f3c-4dd1-9cc2-27cf37bf449e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.250315 Oct 04 12:06:16.327771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 169/346] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:16 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:16.528274 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:16.542437 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-7cab58e3-13ea-4d92-851a-0699f86fc295 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.276902 Oct 04 12:06:16.543606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 178/347] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:16 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:17.342832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:17.344934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:17.368158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:17.369719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:17.370403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:17.372153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:17.373272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:17.373876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:17.570817 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:17.577476 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:17.600154 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:17.600725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:17.601174 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:17.601919 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:17.602876 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:17.604231 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:17.625633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:17.647494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5a6cfb4a-7565-43ee-813a-099ca2637fc2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.315902 Oct 04 12:06:17.664211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 170/348] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:17 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:17.872469 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:17.887181 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a7c6f4c7-5bb7-4773-9953-45a0e952c246 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.323512 Oct 04 12:06:17.890707 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 179/349] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:17 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:18.686679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:18.689561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:18.703643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:18.705147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:18.705970 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:18.706735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:18.707394 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:18.708033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:18.877603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:18.886907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ab54dbd3-9cbe-4233-8ef4-f5232afc6615 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.212126 Oct 04 12:06:18.887518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 171/350] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:18 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:18.919662 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:18.922594 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:18.932203 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:18.932783 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:18.933241 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:18.934023 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:18.934467 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:18.935085 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:19.144300 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:19.158220 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-050d9a69-3d7a-4238-9fe4-d6ffa1f4e6ad tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.248008 Oct 04 12:06:19.159440 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 180/351] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:18 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:19.915320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:19.917195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:19.931392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:19.933206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:19.934335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:19.935652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:19.936743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:19.937805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:20.200969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:20.206995 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:20.212048 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:20.233166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2aa07ade-9897-4442-abe9-196fdbe67d54 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.325309 Oct 04 12:06:20.240777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 172/352] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:19 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:20.241119 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:20.244993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:20.246364 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:20.247697 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:20.253741 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:20.255535 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:20.261376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-f5707638-4945-4596-9a71-48391a13b2f6 req-f5944be7-447d-4199-aa37-170bbd15271f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf295a22-6c0f-4895-9481-d51ee3d122b7", "name": "network-vif-plugged", "status": "completed", "tag": "44eb0f3a-3cfa-4d91-958a-358c9e234313"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:20.289022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-f5707638-4945-4596-9a71-48391a13b2f6 req-f5944be7-447d-4199-aa37-170bbd15271f service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:20.290251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-f5707638-4945-4596-9a71-48391a13b2f6 req-f5944be7-447d-4199-aa37-170bbd15271f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:20.291811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-f5707638-4945-4596-9a71-48391a13b2f6 req-f5944be7-447d-4199-aa37-170bbd15271f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:20.314282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-f5707638-4945-4596-9a71-48391a13b2f6 req-f5944be7-447d-4199-aa37-170bbd15271f service nova] Creating event network-vif-plugged:44eb0f3a-3cfa-4d91-958a-358c9e234313 for instance bf295a22-6c0f-4895-9481-d51ee3d122b7 on hv-cinder-86021 Oct 04 12:06:20.326654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-f5707638-4945-4596-9a71-48391a13b2f6 req-f5944be7-447d-4199-aa37-170bbd15271f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081406 Oct 04 12:06:20.326971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 173/353] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:20.538291 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:20.565882 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e7a23927-48ba-49e7-945d-c196d4928c94 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.373638 Oct 04 12:06:20.580767 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 181/354] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:20 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:21.273783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:21.274708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:21.282284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:21.282879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:21.288522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:21.289517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:21.290475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:21.291027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:21.492984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:21.507285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-52476b6d-08c5-4852-8940-7fea8b081763 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.237851 Oct 04 12:06:21.508345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 174/355] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:21 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:21.610816 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:21.611803 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:21.620442 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:21.621586 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:21.622197 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:21.623043 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:21.623815 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:21.624429 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:21.847344 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:21.861721 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-2709af50-3067-4164-803b-d2058669d033 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1358 microversion: 2.1 time: 0.255112 Oct 04 12:06:21.888423 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 182/356] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:21 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:22.537915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:22.539163 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:22.550501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:22.551074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:22.552475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:22.554507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:22.556214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:22.557123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:22.862371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:22.872098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f3c9cf7a-d33b-4e40-b175-dbd372b7a26b tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.340659 Oct 04 12:06:22.872784 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 175/357] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:22 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:22.907299 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:22.908493 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:22.925726 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:22.927253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:22.928639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:22.930360 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:22.931928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:22.932949 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.173879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:23.186474 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-fb4e39b3-7b52-4650-b3a5-61e40ca816e6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1549 microversion: 2.1 time: 0.286633 Oct 04 12:06:23.187330 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 183/358] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:22 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1549 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:23.219944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:23.220990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:23.230398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.238324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.238324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.238324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.238324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.238940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.423542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:23.441221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4e560a73-313a-43d5-8b60-fa6b6a093cdb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1549 microversion: 2.1 time: 0.225620 Oct 04 12:06:23.457838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 176/359] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:23 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1549 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:23.489019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:23.503058 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:23.504948 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Searching by: {'deleted': False, 'project_id': '950b28fc6faf434482bbb1c2db3fa194'} {{(pid=133084) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 12:06:23.523186 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.524962 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.525453 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.526287 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.526797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.527223 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.633748 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.multi_cell_list [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=133084) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 12:06:23.739657 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-05e338a4-323a-46cf-8f27-41baba03d861 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.261295 Oct 04 12:06:23.740446 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 184/360] 10.222.0.15 () {58 vars in 1125 bytes} [Tue Oct 4 12:06:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:23.753744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:23.754628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:23.761900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.762416 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.762855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.763575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.764079 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.764539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.899300 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:23.899906 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:23.911713 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.911713 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.912404 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:23.912782 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:23.913246 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:23.913692 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:24.016888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:24.039550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5d43058e-339e-44d4-ba76-cf81a81b71fb tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1549 microversion: 2.1 time: 0.289391 Oct 04 12:06:24.040683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 177/361] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:23 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1549 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:24.232989 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:24.245944 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-25e3ca16-d89e-495b-ba8a-3a4fc29b5633 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.351664 Oct 04 12:06:24.246540 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 185/362] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:23 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:25.304103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:25.309846 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:25.318383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=66 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:25.331672 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:25.332845 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:25.333898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:25.335254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:25.336364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:25.337915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:25.601804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:25.609256 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6b7b34e2-1eb4-45b5-9714-55668ea46c71 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.326341 Oct 04 12:06:25.609856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 178/363] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:25 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:26.258241 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72010dd5-086e-4db0-b38f-1eb179d56b60"}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:26.261600 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:26.269044 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:26.269533 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:26.269971 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:26.270736 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:26.271273 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:26.271740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:26.633804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:26.634459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:26.642537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:26.643521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:26.644214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:26.645409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:26.646131 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:26.646827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:26.805029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:26.820823 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9630bedb-7b67-444d-a946-d80b29f285c9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.190593 Oct 04 12:06:26.821918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 179/364] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:26 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:27.847617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:27.849498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:27.861032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:27.861957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:27.862980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:27.864284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:27.865153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:27.865933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:27.902684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:28.113313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:28.122949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c944f408-96f8-4eaa-8182-9fd355b25399 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.281527 Oct 04 12:06:28.123702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 180/365] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:27 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:28.384287 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-7848908d-1bed-49c0-a6e2-9da0cd0d5929 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.129886 Oct 04 12:06:28.385037 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 186/366] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:06:26 2022] POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments => generated 194 bytes in 2132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:29.161185 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:29.161829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:29.169260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:29.169754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:29.170197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:29.170908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:29.171362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:29.171792 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:29.352798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:29.365456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8b346f78-4379-4a57-85f7-99ff27084f2a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.207786 Oct 04 12:06:29.380662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 181/367] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:29 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:30.400444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:30.401804 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:30.404606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=49 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:30.411682 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:30.412952 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:30.413789 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:30.414804 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:30.416163 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:30.417011 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:30.605993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:30.618099 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-1bfd3110-0d6f-426c-9d30-cede98bd70aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1501 microversion: 2.1 time: 0.227662 Oct 04 12:06:30.620051 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 187/368] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:30 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:30.643791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fc54e2e-7f2f-4aa9-a89a-0cdb885d4872"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:30.646574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:30.654658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:30.655187 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:30.660985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:30.660985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:30.660985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:30.660985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:30.708943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] HTTP exception thrown: Cannot 'attach_volume' instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 while it is in vm_state rescued Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Request method failure captured: Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: POST /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934/os-volume_attachments HTTP/1.1 Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 74 Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFKc-ROR5mjgB7LUfF_a4N3_Cx_fLmicq3mvRA9LKnchZ3ZfxgDtwvu51UJzf6DPqiBtokCrYUNA6TNQnkupldIz4SVhh5J73GqMUyVnKJ3QlaVNFi3s47mg9CcRdziYH06w8xQIEU4H7vZ1_s_tf8ivpsIzpDWzLmFuC1vn9kKPW8 Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:06:30.715651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f4f180049cc049829e12eace469bef05", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}] Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: f3f607e48e534dd09c3619982978e9e5 Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {"volumeAttachment": {"volumeId": "9fc54e2e-7f2f-4aa9-a89a-0cdb885d4872"}} Oct 04 12:06:30.717410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Cannot 'attach_volume' instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 while it is in vm_state rescued Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'server_id': '87dbf236-4a32-4b65-b4b5-6e75f778f934', 'body': {'volumeAttachment': {'volumeId': '9fc54e2e-7f2f-4aa9-a89a-0cdb885d4872'}}} Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:06:30.718506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 while it is in vm_state rescued Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:06:30.719922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:06:30.721297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:06:30.721297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:06:30.721297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 while it is in vm_state rescued Oct 04 12:06:30.721297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:06:30.721297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Returning 409 to user: Cannot 'attach_volume' instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 while it is in vm_state rescued {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:06:30.721297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-09bb9716-5807-46bd-ae69-5f810d8fd015 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079269 Oct 04 12:06:30.736533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 182/369] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:06:30 2022] POST /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 12:06:30.756635 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:30.759548 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:30.768152 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:30.768942 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:30.769621 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:30.770856 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:30.773702 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:30.775339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:30.828757 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:31.134187 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9bc682d3-47e8-4ab2-aae3-85d403c95b29 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934/action" status: 202 len: 0 microversion: 2.1 time: 0.389823 Oct 04 12:06:31.135280 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 188/370] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:06:30 2022] POST /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:06:31.148732 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:31.151114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:31.159143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:31.159927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:31.160584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:31.161517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:31.161983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:31.162416 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:31.378782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:31.394980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f256d28f-5ceb-48a0-a8d4-e93f7759d3dd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1509 microversion: 2.1 time: 0.253599 Oct 04 12:06:31.396399 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 183/371] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:31 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:32.426835 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:32.428457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:32.439604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:32.440500 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:32.441289 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:32.449606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:32.449606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:32.449606 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:32.816446 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:32.863540 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-80650827-d635-4838-8c15-6945714b492d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1509 microversion: 2.1 time: 0.438100 Oct 04 12:06:32.894403 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 189/372] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:32 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:33.288957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-901557989", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-25342910", "security_groups": [{"name": "tempest-secgroup-smoke-1755792237"}], "block_device_mapping_v2": [{"uuid": "b5825f32-5844-44bc-84ea-ddc169a658f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5762fef7-720d-4252-ae68-656d8eb02e71"}]}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:33.434713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] validate_networks() for [('5762fef7-720d-4252-ae68-656d8eb02e71', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:06:33.918126 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:33.919466 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:33.929821 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=2 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:33.935528 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:33.939289 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:33.940045 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:33.941035 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:33.945564 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:33.945564 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:34.254534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:06:34.255350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:06:34.256255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:06:34.256986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:06:34.257832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:06:34.275497 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:34.280547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:34.280547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:34.280547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:34.280547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:34.281103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:34.308630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for project d4da0e2bff704d7a944445d0011a8667. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:06:34.315557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for user 76771369a0df4c5189e42291ebdf9d24 and project d4da0e2bff704d7a944445d0011a8667. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:06:34.375719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:34.388466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:06:34.391243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5825f32-5844-44bc-84ea-ddc169a658f6',volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:06:34.410104 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-0df1ffbb-75a8-4f5b-a42c-fe276f37c428 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1509 microversion: 2.1 time: 0.495877 Oct 04 12:06:34.412448 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 190/373] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:33 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1509 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:35.065941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c3998a4e-df2e-4634-b1ac-7e85cb096f80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.780805 Oct 04 12:06:35.068974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 184/374] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:06:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:06:35.088411 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-0046b2ac-3143-4460-b984-6aea610857a4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:35.093431 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-0046b2ac-3143-4460-b984-6aea610857a4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:35.236709 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-0046b2ac-3143-4460-b984-6aea610857a4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:35.264009 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-0046b2ac-3143-4460-b984-6aea610857a4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1092 microversion: 2.1 time: 0.187053 Oct 04 12:06:35.264683 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 191/375] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:35 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1092 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:35.426790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:35.428081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:35.438160 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:35.438668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:35.439111 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:35.440019 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:35.440527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:35.440955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:35.441809 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:35.443250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:35.454201 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:35.455211 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:35.456069 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:35.457144 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:35.458125 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:35.475693 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:35.686622 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:35.707332 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-c974dbef-8ed4-4f75-a043-7b8cdc35714e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1509 microversion: 2.1 time: 0.275607 Oct 04 12:06:35.724449 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 192/376] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:35 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:35.746712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:35.757190 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-22edfd73-4e96-418a-8533-c7508e8df881 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1595 microversion: 2.1 time: 0.338893 Oct 04 12:06:35.764891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 185/377] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:35 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1595 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:36.310428 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f0af9da5-9e7c-4ad0-ba58-487a74ba5d95 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:36.311406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f0af9da5-9e7c-4ad0-ba58-487a74ba5d95 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:36.431458 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f0af9da5-9e7c-4ad0-ba58-487a74ba5d95 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:36.447342 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f0af9da5-9e7c-4ad0-ba58-487a74ba5d95 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1092 microversion: 2.1 time: 0.151431 Oct 04 12:06:36.448738 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 193/378] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:36 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1092 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:36.744637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:36.755843 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:36.786748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:36.793916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:36.797054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:36.802192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:36.808365 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:36.810282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:37.207824 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:37.226493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-80fc9c86-1a5a-4160-ac80-e2430d49418e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1509 microversion: 2.1 time: 0.498087 Oct 04 12:06:37.228743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 186/379] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:36 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1509 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:37.496677 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:37.499415 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:37.515339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:37.516796 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:37.517900 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:37.519593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:37.520720 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:37.521768 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:37.615652 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:37.624892 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-503002d1-34b4-436d-b00c-f0b7fe0c8f77 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1142 microversion: 2.1 time: 0.140962 Oct 04 12:06:37.625597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 194/380] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:37 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1142 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:38.256993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:38.272404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:38.272404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:38.272404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:38.272404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:38.273168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:38.273168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:38.273168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:38.523486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:38.535445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9c3ba88a-22e3-4028-adcc-52a1e33ed4bf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1509 microversion: 2.1 time: 0.282352 Oct 04 12:06:38.536595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 187/381] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:38 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:38.657242 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:38.661846 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:38.679304 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:38.685101 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:38.686253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:38.687798 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:38.689065 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:38.690410 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:38.834141 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:38.883370 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-43165bc6-684f-4998-b80c-7c4d190313d6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1134 microversion: 2.1 time: 0.199241 Oct 04 12:06:38.883370 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 195/382] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:38 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1134 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:39.577831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:39.578931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:39.591630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:39.592860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:39.593853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:39.595405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:39.596528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:39.597599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:39.871813 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:39.872572 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:39.889250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:39.890061 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:39.890979 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:39.897478 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:39.898884 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:39.900120 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:40.033558 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:40.049642 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0d36cd94-4308-42e1-a042-9fe1e58cc46f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1515 microversion: 2.1 time: 0.479577 Oct 04 12:06:40.051202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 188/383] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:39 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1515 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:40.097978 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:40.138939 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5a957f85-10ce-41d9-aa1f-0e0c08ca3afd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1190 microversion: 2.1 time: 0.271336 Oct 04 12:06:40.139807 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 196/384] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:39 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1190 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:40.296688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-935ae003-2197-48d2-992a-44bad624378a req-787d5743-42f3-4c3f-a639-715641871e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf295a22-6c0f-4895-9481-d51ee3d122b7", "tag": "44eb0f3a-3cfa-4d91-958a-358c9e234313"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:40.332072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-935ae003-2197-48d2-992a-44bad624378a req-787d5743-42f3-4c3f-a639-715641871e1d service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:40.335047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-935ae003-2197-48d2-992a-44bad624378a req-787d5743-42f3-4c3f-a639-715641871e1d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:40.337993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-935ae003-2197-48d2-992a-44bad624378a req-787d5743-42f3-4c3f-a639-715641871e1d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:40.373825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-935ae003-2197-48d2-992a-44bad624378a req-787d5743-42f3-4c3f-a639-715641871e1d service nova] Creating event network-changed:44eb0f3a-3cfa-4d91-958a-358c9e234313 for instance bf295a22-6c0f-4895-9481-d51ee3d122b7 on hv-cinder-86021 Oct 04 12:06:40.388565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-935ae003-2197-48d2-992a-44bad624378a req-787d5743-42f3-4c3f-a639-715641871e1d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100460 Oct 04 12:06:40.398006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 189/385] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:06:41.170008 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:41.170875 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:41.190091 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:41.191114 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:41.194074 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:41.197370 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:41.200330 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:41.205287 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:41.625360 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:41.659539 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f230679a-5710-4010-951e-6a21592b88ad tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1190 microversion: 2.1 time: 0.496519 Oct 04 12:06:41.665607 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 197/386] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:41 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1190 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:42.465560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9b57b891-9752-4e38-b31d-8a7af37a79cc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'create', calling method: .version_select at 0x7f10c385c790>, body: {"keypair": {"name": "tempest-keypair-1858151413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWMIKPzdk1BJIuQs3XHu58AMtU2mq/hvEdYauGrOEvHE0mv4E/bRzUjqPEKzAyV/shl7B7Nv+qPXw6XJbep7wwafWhvbzGJjvPfRqlBmy0lWXQbnj/N2I/aaztuNF4f5A=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:42.501097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-9b57b891-9752-4e38-b31d-8a7af37a79cc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for project f4f180049cc049829e12eace469bef05. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:06:42.512290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-9b57b891-9752-4e38-b31d-8a7af37a79cc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for user f3f607e48e534dd09c3619982978e9e5 and project f4f180049cc049829e12eace469bef05. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:06:42.646505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9b57b891-9752-4e38-b31d-8a7af37a79cc tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185400 Oct 04 12:06:42.648791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 190/387] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:06:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:42.722686 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:42.724300 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:42.748444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:42.749680 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:42.750737 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:42.752492 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:42.754290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:42.755245 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:42.981151 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:43.000124 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d477f1f1-876e-434a-ae5e-38cef01c8881 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1208 microversion: 2.1 time: 0.302637 Oct 04 12:06:43.002173 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 198/388] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:42 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1208 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:43.404752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:43.406385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:43.422184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:43.423602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:43.425041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:43.427023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:43.428251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:43.429143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:43.729435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lazy-loading 'services' on Instance uuid 889c6e11-6374-4ec0-aacc-addc853c945d {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:06:44.049010 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:44.051019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:44.069257 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:44.069756 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:44.072962 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:44.074113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:44.075015 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:44.075292 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:44.178664 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-69fa70a1-2503-4485-9f98-edffee4a2391 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-volume_attachments/b4b7f52a-5dac-4971-bb64-eb2f1d347d65" status: 202 len: 0 microversion: 2.1 time: 0.783475 Oct 04 12:06:44.179683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 191/389] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:06:43 2022] DELETE /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-volume_attachments/b4b7f52a-5dac-4971-bb64-eb2f1d347d65 => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:06:44.267919 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:44.295401 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d5642245-8b08-4835-aaf0-d6d84d94ec10 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1208 microversion: 2.1 time: 0.251652 Oct 04 12:06:44.304343 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 199/390] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:44 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1208 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:45.337784 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:45.342393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-528165827"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:45.343070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:45.353215 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:45.354103 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:45.356955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:45.360158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:45.361590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:45.364646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:45.365529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:45.375238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:45.375673 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:45.376431 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:45.377314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:45.378133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:45.378557 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:45.379072 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:45.716761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.network.security_group_api [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Adding security group 95963f88-c138-46c0-be83-5d288a553484 to port 44eb0f3a-3cfa-4d91-958a-358c9e234313 Oct 04 12:06:45.726446 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:45.739310 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-dcf21c7e-d897-4ec9-8ae4-6e34994e1460 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1276 microversion: 2.1 time: 0.394175 Oct 04 12:06:45.740142 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 200/391] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:45 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1276 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:46.545195 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a00622bb-45b8-422f-82a8-512a0461e5a5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:46.549214 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=4 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:46.557290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a00622bb-45b8-422f-82a8-512a0461e5a5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:46.557290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a00622bb-45b8-422f-82a8-512a0461e5a5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:46.557290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a00622bb-45b8-422f-82a8-512a0461e5a5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:46.580865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a00622bb-45b8-422f-82a8-512a0461e5a5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Going to try to stop instance {{(pid=133084) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 12:06:46.640750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e610d08b-2bfc-4f63-a0a7-7cd9332983ac tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/action" status: 202 len: 0 microversion: 2.1 time: 1.304574 Oct 04 12:06:46.641411 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 192/392] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:06:45 2022] POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/action => generated 0 bytes in 1306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:06:46.666502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:46.669766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:46.682534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:46.683385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:46.684825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:46.685807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:46.686459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:46.687054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:46.894669 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a00622bb-45b8-422f-82a8-512a0461e5a5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action" status: 202 len: 0 microversion: 2.1 time: 0.353374 Oct 04 12:06:46.901067 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 201/393] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:06:46 2022] POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:06:46.918729 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-f096dcc5-da59-42ce-89d9-6436034485b7 req-a3912164-c812-4bc9-a8fc-0f8966921bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf295a22-6c0f-4895-9481-d51ee3d122b7", "tag": "44eb0f3a-3cfa-4d91-958a-358c9e234313"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:46.939298 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f096dcc5-da59-42ce-89d9-6436034485b7 req-a3912164-c812-4bc9-a8fc-0f8966921bd2 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:46.940408 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f096dcc5-da59-42ce-89d9-6436034485b7 req-a3912164-c812-4bc9-a8fc-0f8966921bd2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:46.941192 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-f096dcc5-da59-42ce-89d9-6436034485b7 req-a3912164-c812-4bc9-a8fc-0f8966921bd2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:46.973622 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-f096dcc5-da59-42ce-89d9-6436034485b7 req-a3912164-c812-4bc9-a8fc-0f8966921bd2 service nova] Creating event network-changed:44eb0f3a-3cfa-4d91-958a-358c9e234313 for instance bf295a22-6c0f-4895-9481-d51ee3d122b7 on hv-cinder-86021 Oct 04 12:06:46.981648 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-f096dcc5-da59-42ce-89d9-6436034485b7 req-a3912164-c812-4bc9-a8fc-0f8966921bd2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077383 Oct 04 12:06:46.982704 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 202/394] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:46.995240 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:46.996038 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:47.012733 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:47.015453 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:47.015453 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:47.016648 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:47.017644 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:47.018257 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:47.246758 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:47.254658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a3596dc3-32cf-4205-b6a6-ca46f9104eb8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1760 microversion: 2.1 time: 0.605739 Oct 04 12:06:47.256095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 193/395] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:46 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1760 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:47.261976 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:47.262833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:47.271892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:47.272716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:47.273346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:47.274833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:47.275768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:47.276570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:47.281712 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:47.298093 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-3894f205-a75e-41c6-8512-0f49bfdf3f67 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.311542 Oct 04 12:06:47.303619 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 203/396] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:46 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:47.309093 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-4f8874f3-6204-40e2-b123-137f89a532c6 req-c72957ae-a978-4dc6-a78e-23116c759752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5b93b6-ec32-4534-b51b-15e8eeb734d1", "tag": "3a1010f5-4eac-4dd5-9fa0-faf7a2c11531"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:47.332858 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4f8874f3-6204-40e2-b123-137f89a532c6 req-c72957ae-a978-4dc6-a78e-23116c759752 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:47.337494 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4f8874f3-6204-40e2-b123-137f89a532c6 req-c72957ae-a978-4dc6-a78e-23116c759752 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:47.338010 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4f8874f3-6204-40e2-b123-137f89a532c6 req-c72957ae-a978-4dc6-a78e-23116c759752 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:47.371184 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-4f8874f3-6204-40e2-b123-137f89a532c6 req-c72957ae-a978-4dc6-a78e-23116c759752 service nova] Creating event network-changed:3a1010f5-4eac-4dd5-9fa0-faf7a2c11531 for instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 on hv-cinder-86021 Oct 04 12:06:47.398384 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-4f8874f3-6204-40e2-b123-137f89a532c6 req-c72957ae-a978-4dc6-a78e-23116c759752 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091616 Oct 04 12:06:47.398384 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 204/397] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:47.681574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:47.693647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5de0933d-caad-4b7b-a724-f3ff104c5937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.436001 Oct 04 12:06:47.694692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 194/398] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:47 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:47.996685 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2053741971", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea9a6710-a6c4-4b51-9ca2-9cfb36ef37b3"}], "security_groups": [{"name": "tempest-securitygroup--796087497"}], "key_name": "tempest-keypair-1858151413", "user_data": "}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:48.309272 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] validate_networks() for [('ea9a6710-a6c4-4b51-9ca2-9cfb36ef37b3', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:06:48.333068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:48.334207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:48.344923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:48.345701 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:48.346371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:48.347820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:48.348581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:48.349285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:48.593610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:48.605574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-024be695-0843-49fa-a45a-c94ed573eddc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.277932 Oct 04 12:06:48.606386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 195/399] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:48 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:48.731811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:48.732665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:48.739363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:48.741596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:48.741596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:48.741596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:48.741931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:48.743036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:48.964540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:48.980490 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-efd2669c-a3ac-4def-8798-f13b80e164e0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.252015 Oct 04 12:06:48.981644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 196/400] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:48 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:48.987993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:06:48.989077 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:06:48.990083 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:06:48.991184 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:06:48.992374 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:06:49.007245 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:49.007954 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:49.008255 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:49.009515 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:49.009972 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:49.010398 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:49.029472 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for project f4f180049cc049829e12eace469bef05. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:06:49.034439 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Getting quotas for user f3f607e48e534dd09c3619982978e9e5 and project f4f180049cc049829e12eace469bef05. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:06:49.047567 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:06:49.050090 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:06:49.338537 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-268e0be0-8fe0-411c-8401-e821a400b702 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.351885 Oct 04 12:06:49.338965 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 205/401] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:06:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:06:49.357271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bc08cb0e-66dd-4003-885f-6322425b1395 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:49.358928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bc08cb0e-66dd-4003-885f-6322425b1395 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:49.474891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bc08cb0e-66dd-4003-885f-6322425b1395 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:49.493541 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bc08cb0e-66dd-4003-885f-6322425b1395 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1246 microversion: 2.1 time: 0.145999 Oct 04 12:06:49.495398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 197/402] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:49 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1246 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:49.637290 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:49.638790 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:49.654901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:49.656326 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:49.657399 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:49.658952 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:49.660042 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:49.661088 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:49.862204 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:49.874193 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-1208593d-9fde-41da-9e25-5295e943bc91 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.246246 Oct 04 12:06:49.874980 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 206/403] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:49 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:50.019290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:50.020685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:50.031924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:50.032830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:50.036327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:50.036327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:50.036327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:50.036724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:50.262444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:50.272006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e69026d3-74be-4d27-b0eb-8e1458751a66 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.260358 Oct 04 12:06:50.272646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 198/404] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:50 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:50.521880 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-46a013c1-2d4a-4364-8c74-896f1de6113f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:50.522692 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-46a013c1-2d4a-4364-8c74-896f1de6113f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:50.600204 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-46a013c1-2d4a-4364-8c74-896f1de6113f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:50.615222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-46a013c1-2d4a-4364-8c74-896f1de6113f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1246 microversion: 2.1 time: 0.098013 Oct 04 12:06:50.620681 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 207/405] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:50 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:50.900270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:50.900899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:50.908212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:50.908702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:50.909136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:50.909838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:50.910336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:50.911036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:51.085957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:51.098302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a675ce8b-fc89-41c2-b1fd-78983320ad38 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.202570 Oct 04 12:06:51.099395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 199/406] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:50 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:51.296126 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:51.296767 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:51.303688 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:51.304239 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:51.304676 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:51.306027 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:51.306518 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:51.306943 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:51.312874 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:51.510839 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:51.528436 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-ad31926f-4830-42bc-8971-8cfa75d18693 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.236272 Oct 04 12:06:51.529539 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 208/407] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:51 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:51.643433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:51.644062 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:51.651470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:51.651971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:51.652454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:51.653196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:51.654354 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:51.654354 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:51.686956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:51.746382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:51.756862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c350694a-542c-4cd3-86e9-10eeabe77abd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1242 microversion: 2.1 time: 0.116924 Oct 04 12:06:51.757729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 200/408] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:51 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:52.126327 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:52.127200 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:52.136098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:52.141682 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:52.141682 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:52.141682 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:52.141682 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:52.142033 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:52.402008 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:52.417046 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-db5e4101-f60e-46be-8fae-f691fb57d110 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.295199 Oct 04 12:06:52.418535 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 209/409] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:52 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:52.560756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:52.562173 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:52.575890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:52.576935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:52.577849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:52.579272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:52.580325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:52.581219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:52.791223 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:52.793084 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:52.816535 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:52.817515 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:52.818475 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:52.819867 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:52.821303 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:52.822177 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:52.900406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:52.914669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-234ccf0a-7051-4b61-b661-6da8d6aa2c96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.361893 Oct 04 12:06:52.923020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 201/410] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:52 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:52.927568 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:52.936463 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-4bba54d8-689c-4184-adc1-46e9b7f80393 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1298 microversion: 2.1 time: 0.153122 Oct 04 12:06:52.961990 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 210/411] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:52 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:53.456130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:53.457015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:53.465577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:53.466080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:53.466540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:53.467251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:53.467710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:53.468140 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:53.694351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:53.716323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-15b94433-8611-4714-9cc7-152eca4e331f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.265387 Oct 04 12:06:53.719038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 202/412] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:53 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:53.953152 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:53.953876 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:53.964588 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:53.965538 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:53.966258 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:53.967260 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:53.968052 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:53.968883 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:53.986247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:53.986878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:53.993793 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:53.994573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:53.995197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:53.996192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:53.996871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:53.997490 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:54.068396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:54.079749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7538d502-db00-4f20-b9b9-7517fe48d793 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1304 microversion: 2.1 time: 0.097074 Oct 04 12:06:54.080610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 203/413] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:53 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:54.696561 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:54.707814 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f4059df7-9ab6-4d87-b842-3c596f6fa13c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.760169 Oct 04 12:06:54.708723 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 211/414] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:53 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:54.748777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:54.750638 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:54.757221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:54.757795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:54.758448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:54.759192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:54.759755 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:54.760254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:54.926078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:54.941394 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-df23a35a-59fb-4189-98b5-bd05c65cf8e8 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.197617 Oct 04 12:06:54.942565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 204/415] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:54 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:55.108471 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:55.109539 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:55.121945 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:55.122883 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:55.123652 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:55.125262 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:55.126088 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:55.127123 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:55.364790 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:55.373887 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9bf8a60e-db3d-48ae-ad1f-58ac978bc841 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.271821 Oct 04 12:06:55.374531 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 212/416] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:55 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:55.744648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:55.746701 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:55.750055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:55.757796 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:55.759063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:55.759695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:55.760828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:55.761890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:55.763149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:55.967911 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:55.969566 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:55.980286 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:55.981940 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:55.983173 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:55.989770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:55.990072 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:55.991405 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:55.993205 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:56.008139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b8718741-b3a5-4bdb-8e84-9c1aa78a86f8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.273132 Oct 04 12:06:56.021471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 205/417] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:55 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:56.209168 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:56.220834 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-056138c5-fe0d-45a5-b17f-2e101e156200 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.258193 Oct 04 12:06:56.221711 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 213/418] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:55 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:56.414023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:56.415071 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:56.421852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:56.422361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:56.422798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:56.423530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:56.423987 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:56.424444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:56.610644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:56.620961 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-18196039-53fd-4be5-b23c-2dba96b478cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.212187 Oct 04 12:06:56.621797 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 206/419] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:56 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:56.899093 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-4ff5ab46-dacf-4dd2-90e5-51863fdd66a3 req-1ab7f977-29f2-4c71-9800-918b85053050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a45ae82-9e63-4ac4-84c9-6ec1d61556a8", "tag": "b026d660-150c-4793-803c-fc2cbcfe5527"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:06:56.912209 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4ff5ab46-dacf-4dd2-90e5-51863fdd66a3 req-1ab7f977-29f2-4c71-9800-918b85053050 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:56.919559 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4ff5ab46-dacf-4dd2-90e5-51863fdd66a3 req-1ab7f977-29f2-4c71-9800-918b85053050 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:56.919559 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-4ff5ab46-dacf-4dd2-90e5-51863fdd66a3 req-1ab7f977-29f2-4c71-9800-918b85053050 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:56.929451 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-4ff5ab46-dacf-4dd2-90e5-51863fdd66a3 req-1ab7f977-29f2-4c71-9800-918b85053050 service nova] Creating event network-changed:b026d660-150c-4793-803c-fc2cbcfe5527 for instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 on hv-cinder-86021 Oct 04 12:06:56.936500 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-4ff5ab46-dacf-4dd2-90e5-51863fdd66a3 req-1ab7f977-29f2-4c71-9800-918b85053050 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044819 Oct 04 12:06:56.937506 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 214/420] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:06:57.049315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:57.049930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:57.057348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:57.060154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:57.060154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:57.060154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:57.060154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:57.060775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:57.251208 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:57.252349 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:57.266483 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:57.266483 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:57.266483 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:57.267811 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:57.269704 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:57.270765 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:57.270976 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:57.280848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9eb8e184-3341-46d0-9f2d-6963bf8ec93a tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.235785 Oct 04 12:06:57.281344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 207/421] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:57 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:57.537280 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:57.545801 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a9621508-c0fd-42cb-af46-37b3d97d5d24 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.299303 Oct 04 12:06:57.546545 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 215/422] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:57 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:57.650396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:57.651125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:57.658182 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:57.658679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:57.659174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:57.659890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:57.660409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:57.660839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:57.847403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:57.856374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e0873d0f-7fdd-4234-8e88-8ad7a24183e3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.210661 Oct 04 12:06:57.857331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 208/423] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:57 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:58.306434 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:58.307047 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:58.316668 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:58.317644 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:58.318500 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:58.319726 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:58.320812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:58.321468 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:58.514005 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:58.528413 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-9c9fdfcd-d709-48fb-a4b1-926cfc04a0be tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.225976 Oct 04 12:06:58.529364 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 216/424] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:58 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:58.571257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:58.572260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:58.579623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:58.583392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:58.583392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:58.583392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:58.583392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:58.584108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:58.733613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:58.742327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2f67686b-d509-4a29-8a10-e3c1cca7f675 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.175002 Oct 04 12:06:58.742922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 209/425] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:58 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:58.880518 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:58.881173 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:58.888215 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:58.888703 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:58.889143 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:58.889849 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:58.890305 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:58.890724 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:59.019300 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=2 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:59.093524 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:59.103569 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-262c218e-89c7-4895-afcd-f436d472ff14 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.227229 Oct 04 12:06:59.104471 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 217/426] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:58 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:06:59.553574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:59.554191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:59.556911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=12 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:06:59.562469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:59.562962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:59.563462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:59.564245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:59.564704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:59.565120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:59.718481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:59.727702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ec374a3d-f502-4954-9ef7-e164c8359724 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.178140 Oct 04 12:06:59.728537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 210/427] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:59 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:06:59.767171 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:06:59.767957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:06:59.775309 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:59.775872 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:59.776380 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:59.777137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:06:59.777638 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:06:59.778198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:06:59.940568 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:06:59.959649 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6233dab2-6493-4e88-b623-2bd7b9b56e00 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.186649 Oct 04 12:06:59.959649 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 218/428] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:06:59 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:00.128508 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:00.129135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:00.137006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:00.137768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:00.138405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:00.139400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:00.139918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:00.140518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:00.302710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:00.316829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8418c69d-7b77-44de-b9f8-b32a66d7fbdf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.192490 Oct 04 12:07:00.317730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 211/429] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:00 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:00.658985 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-520f1588-28e3-46b8-af25-55af2a9a49c3 req-cab3b292-7ab6-44df-a022-80199c1fbea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5b93b6-ec32-4534-b51b-15e8eeb734d1", "name": "network-vif-plugged", "status": "completed", "tag": "3a1010f5-4eac-4dd5-9fa0-faf7a2c11531"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:00.668777 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=8 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:00.668777 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:00.673131 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-520f1588-28e3-46b8-af25-55af2a9a49c3 req-cab3b292-7ab6-44df-a022-80199c1fbea4 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:00.673639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-520f1588-28e3-46b8-af25-55af2a9a49c3 req-cab3b292-7ab6-44df-a022-80199c1fbea4 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:00.674071 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-520f1588-28e3-46b8-af25-55af2a9a49c3 req-cab3b292-7ab6-44df-a022-80199c1fbea4 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:00.687928 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-520f1588-28e3-46b8-af25-55af2a9a49c3 req-cab3b292-7ab6-44df-a022-80199c1fbea4 service nova] Creating event network-vif-plugged:3a1010f5-4eac-4dd5-9fa0-faf7a2c11531 for instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 on hv-cinder-86021 Oct 04 12:07:00.693500 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-520f1588-28e3-46b8-af25-55af2a9a49c3 req-cab3b292-7ab6-44df-a022-80199c1fbea4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038510 Oct 04 12:07:00.694116 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 219/430] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:07:00.755276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:00.756104 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:00.764320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:00.764945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:00.765441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:00.766159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:00.766612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:00.767040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:00.950374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:00.966008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c9174c21-e670-41f7-8445-05b0a162f0bc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.216506 Oct 04 12:07:00.967181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 212/431] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:00 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:00.985285 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:00.986198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:00.993641 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:00.994321 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:00.994834 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:00.995678 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:00.996246 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:00.996863 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:01.222126 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:01.251069 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e0d62200-c468-409f-ac3c-ef4820f62b99 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.270702 Oct 04 12:07:01.252371 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 220/432] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:00 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:01.341842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:01.342514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:01.349138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:01.349812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:01.350306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:01.351721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:01.352302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:01.352949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:01.524711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:01.540229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0703b2b0-ad8f-4e0d-81e1-ac763aaeb12d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.201453 Oct 04 12:07:01.541274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 213/433] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:01 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:02.005740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:02.006430 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:02.013623 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:02.014107 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:02.014540 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:02.015250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:02.015703 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:02.016210 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:02.173930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:02.189253 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-6e7bea64-3e40-4435-8936-ec4b18faf692 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1676 microversion: 2.1 time: 0.187248 Oct 04 12:07:02.190287 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 221/434] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:02 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:02.277332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:02.279205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:02.290906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:02.291663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:02.292421 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:02.293662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:02.294300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:02.295002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:02.499444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:02.515098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4efd87c0-78e2-4034-bef8-85a161cebfdc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.242827 Oct 04 12:07:02.516537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 214/435] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:02 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:02.583319 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:02.584615 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:02.592778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:02.593535 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:02.594152 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:02.595140 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:02.595778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:02.596473 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:02.797620 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:02.813797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d5b39250-e798-4e38-8300-31e41ec1801c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.238742 Oct 04 12:07:02.816263 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 222/436] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:02 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:03.216852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:03.217534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:03.225995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.227217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.227782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.228961 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.229535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.230236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.414199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:03.423857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-812d88bc-1f0f-48f0-b3f6-3cc45e19c121 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1653 microversion: 2.1 time: 0.211537 Oct 04 12:07:03.424921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 215/437] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:03 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1653 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:03.449986 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-4acbc804-bae9-41d8-b766-fd93df78b950 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:03.457407 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4acbc804-bae9-41d8-b766-fd93df78b950 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.458030 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4acbc804-bae9-41d8-b766-fd93df78b950 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.458485 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-4acbc804-bae9-41d8-b766-fd93df78b950 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.496331 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-4acbc804-bae9-41d8-b766-fd93df78b950 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Going to try to start instance {{(pid=133084) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 12:07:03.542792 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:03.544104 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:03.553248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.553715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.554401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.556614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.556898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.557343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.738257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:03.754677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bfd177a4-8ee6-4a01-bbcf-95e4dd7eadb4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1264 microversion: 2.1 time: 0.218862 Oct 04 12:07:03.756580 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 216/438] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:03 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:03.763949 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-4acbc804-bae9-41d8-b766-fd93df78b950 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action" status: 202 len: 0 microversion: 2.1 time: 0.319537 Oct 04 12:07:03.768437 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 223/439] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:07:03 2022] POST /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:07:03.778849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:03.780111 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:03.791945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.792624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.793044 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.796390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.797714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.798651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.808414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:03.849797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:03.851291 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:03.862828 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.863706 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.864576 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:03.865861 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:03.867232 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:03.868011 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:04.064374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:04.078384 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c8b42a52-81d0-450e-b00a-8402f1766dfb tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1662 microversion: 2.1 time: 0.307262 Oct 04 12:07:04.080088 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 217/440] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:03 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1662 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:04.131610 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:04.140828 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b68cfb61-7a3a-46c6-998d-1cbfe2634a23 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.297586 Oct 04 12:07:04.141444 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 224/441] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:03 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:04.801283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:04.806689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:04.817125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:04.817646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:04.818105 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:04.818853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:04.819599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:04.820942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.053169 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:05.068482 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-041c5d29-7e9f-48e9-86f4-d67364164d33 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1451 microversion: 2.1 time: 0.274659 Oct 04 12:07:05.073295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 218/442] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:04 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1451 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:05.101222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:05.105259 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:05.109345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:05.110327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:05.115556 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:05.117725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:05.118589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:05.119351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:05.119629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.120132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.121109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:05.121742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:05.121864 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:05.122494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.122976 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:05.123865 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.134391 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:05.370544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:05.383540 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:05.390760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8841af14-bce6-41fa-8825-150e254c8255 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1662 microversion: 2.1 time: 0.286908 Oct 04 12:07:05.392781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 219/443] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:05 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1662 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:05.393103 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-621bfd34-aaba-4617-b15a-dc668f9e1b7b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1451 microversion: 2.1 time: 0.300861 Oct 04 12:07:05.394036 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 225/444] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:05 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1451 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:05.400055 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [req-b199e786-2d61-4911-963a-6b955331c6df req-15a87253-722e-4a59-bdf0-5518b50322b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a45ae82-9e63-4ac4-84c9-6ec1d61556a8", "name": "network-vif-plugged", "status": "completed", "tag": "b026d660-150c-4793-803c-fc2cbcfe5527"}]} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:05.403816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:05.405254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:05.412599 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-b199e786-2d61-4911-963a-6b955331c6df req-15a87253-722e-4a59-bdf0-5518b50322b9 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:05.413293 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-b199e786-2d61-4911-963a-6b955331c6df req-15a87253-722e-4a59-bdf0-5518b50322b9 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:05.414193 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [req-b199e786-2d61-4911-963a-6b955331c6df req-15a87253-722e-4a59-bdf0-5518b50322b9 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.422806 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:05.423832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:05.424751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.426168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:05.427204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:05.428068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:05.435669 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.compute.server_external_events [req-b199e786-2d61-4911-963a-6b955331c6df req-15a87253-722e-4a59-bdf0-5518b50322b9 service nova] Creating event network-vif-plugged:b026d660-150c-4793-803c-fc2cbcfe5527 for instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 on hv-cinder-86021 Oct 04 12:07:05.446302 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [req-b199e786-2d61-4911-963a-6b955331c6df req-15a87253-722e-4a59-bdf0-5518b50322b9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046733 Oct 04 12:07:05.446302 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 226/445] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:05.717769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:05.730164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fa3b0b9f-69cb-46d5-a85d-1e9635bfe650 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.335131 Oct 04 12:07:05.731126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 220/446] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:05 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:06.420503 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:06.421629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:06.430490 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:06.431098 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:06.431729 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:06.432603 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:06.433365 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:06.433857 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:06.692993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:06.703536 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-dcf07bfd-9030-4d75-859c-d3bed3e91447 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1666 microversion: 2.1 time: 0.289848 Oct 04 12:07:06.704953 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 227/447] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:06 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1666 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:06.764936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:06.766130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:06.780205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:06.781097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:06.787514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:06.788937 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:06.789966 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:06.790667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:07.018990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:07.030125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7748ce67-3d7a-4b93-bb5b-6f613d09f086 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.274205 Oct 04 12:07:07.031424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 221/448] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:06 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:08.059277 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:08.060443 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:08.071782 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:08.072642 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:08.073311 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:08.074476 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:08.075858 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:08.076048 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:08.364492 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:08.375275 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b81c3832-57a6-42ae-bc4a-9a218ec0330d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.323401 Oct 04 12:07:08.376124 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 228/449] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:08 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:08.918006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-7c674084-3206-489a-8bde-92c8be16c4d6 req-f58068f4-34ab-4ae2-adf5-ebe110c6077d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5b93b6-ec32-4534-b51b-15e8eeb734d1", "tag": "3a1010f5-4eac-4dd5-9fa0-faf7a2c11531"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:08.936895 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7c674084-3206-489a-8bde-92c8be16c4d6 req-f58068f4-34ab-4ae2-adf5-ebe110c6077d service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:08.937751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7c674084-3206-489a-8bde-92c8be16c4d6 req-f58068f4-34ab-4ae2-adf5-ebe110c6077d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:08.938513 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7c674084-3206-489a-8bde-92c8be16c4d6 req-f58068f4-34ab-4ae2-adf5-ebe110c6077d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:08.961374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-7c674084-3206-489a-8bde-92c8be16c4d6 req-f58068f4-34ab-4ae2-adf5-ebe110c6077d service nova] Creating event network-changed:3a1010f5-4eac-4dd5-9fa0-faf7a2c11531 for instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 on hv-cinder-86021 Oct 04 12:07:08.970187 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-7c674084-3206-489a-8bde-92c8be16c4d6 req-f58068f4-34ab-4ae2-adf5-ebe110c6077d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059910 Oct 04 12:07:08.971540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 222/450] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:09.404130 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:09.405546 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:09.419977 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:09.421774 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:09.422969 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:09.424598 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:09.425626 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:09.426566 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:09.653045 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:09.663888 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-deedbcad-26d0-439a-b92b-f5780003eb68 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1371 microversion: 2.1 time: 0.266858 Oct 04 12:07:09.664667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 229/451] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:09 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:10.706787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:10.708012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:10.721344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:10.722200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:10.722953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:10.724237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:10.725089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:10.725940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:10.936953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:10.950096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c5e1aba8-f9b3-4c3d-8934-d5ab794bb5af tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1564 microversion: 2.1 time: 0.253025 Oct 04 12:07:10.951125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 223/452] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:10 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:10.994682 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:10.995786 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:11.007981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:11.008981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:11.009866 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:11.011361 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:11.012233 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:11.012955 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:11.141311 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e2f21b9d-9e6b-4362-b7a6-ba96bb8c74ce tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154131 Oct 04 12:07:11.142432 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 230/453] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:07:10 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:12.879716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-4c4e7a35-a8d3-4584-b15e-f8901289c7e9 req-0be55324-373d-4f73-ab26-da3bbc481ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a45ae82-9e63-4ac4-84c9-6ec1d61556a8", "tag": "b026d660-150c-4793-803c-fc2cbcfe5527"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:12.894430 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-4c4e7a35-a8d3-4584-b15e-f8901289c7e9 req-0be55324-373d-4f73-ab26-da3bbc481ebe service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:12.895630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-4c4e7a35-a8d3-4584-b15e-f8901289c7e9 req-0be55324-373d-4f73-ab26-da3bbc481ebe service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:12.896457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-4c4e7a35-a8d3-4584-b15e-f8901289c7e9 req-0be55324-373d-4f73-ab26-da3bbc481ebe service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:12.919402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-4c4e7a35-a8d3-4584-b15e-f8901289c7e9 req-0be55324-373d-4f73-ab26-da3bbc481ebe service nova] Creating event network-changed:b026d660-150c-4793-803c-fc2cbcfe5527 for instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 on hv-cinder-86021 Oct 04 12:07:12.929374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-4c4e7a35-a8d3-4584-b15e-f8901289c7e9 req-0be55324-373d-4f73-ab26-da3bbc481ebe service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060603 Oct 04 12:07:12.930833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 224/454] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:21.387645 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=23 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:21.389455 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=28 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:21.398257 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:21.399126 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:21.410262 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:21.411483 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:21.412471 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:21.416991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:21.416991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:21.416991 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:21.504564 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a88ba650-e206-4a7d-8eca-587ea6b6ad48 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff/ips" status: 200 len: 150 microversion: 2.1 time: 0.119603 Oct 04 12:07:21.505703 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 231/455] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:07:21 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff/ips => generated 150 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:21.531143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af67dc62-9bea-4aa5-bce4-5c3512d1657c"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:21.535914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:21.550514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:21.560347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:21.560347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:21.560347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:21.560347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:21.560708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:21.693771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Invalid volume: volume af67dc62-9bea-4aa5-bce4-5c3512d1657c is already attached to instances: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: POST /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff/os-volume_attachments HTTP/1.1 Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 74 Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:07:21.697483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {"volumeAttachment": {"volumeId": "af67dc62-9bea-4aa5-bce4-5c3512d1657c"}} Oct 04 12:07:21.699155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Invalid volume: volume af67dc62-9bea-4aa5-bce4-5c3512d1657c is already attached to instances: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'server_id': 'bbd8bd8a-3940-41fa-9d04-8d64e5932dff', 'body': {'volumeAttachment': {'volumeId': 'af67dc62-9bea-4aa5-bce4-5c3512d1657c'}}} Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af67dc62-9bea-4aa5-bce4-5c3512d1657c is already attached to instances: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:07:21.700124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af67dc62-9bea-4aa5-bce4-5c3512d1657c is already attached to instances: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:21.701643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:07:21.703178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:07:21.703178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:07:21.703178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:07:21.703178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af67dc62-9bea-4aa5-bce4-5c3512d1657c is already attached to instances: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b Oct 04 12:07:21.703178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:07:21.703178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 400 to user: Invalid volume: volume af67dc62-9bea-4aa5-bce4-5c3512d1657c is already attached to instances: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:07:21.703178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-abce23bc-88c4-4347-bdbc-beed47ee56c7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.177567 Oct 04 12:07:21.709070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 225/456] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:07:21 2022] POST /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff/os-volume_attachments => generated 174 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 12:07:21.715557 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:21.716599 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:21.732803 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:21.735029 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:21.735572 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:21.736509 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:21.737096 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:21.737587 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:21.780457 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Going to try to terminate instance {{(pid=133084) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:07:22.216823 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-973dd9a8-aa17-43e2-8c08-a1f571b506db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 204 len: 0 microversion: 2.1 time: 0.508628 Oct 04 12:07:22.217814 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 232/457] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:07:21 2022] DELETE /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:07:22.228320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:22.229311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:22.240385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:22.241868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:22.242496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:22.243245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:22.243710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:22.244136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:22.463509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:22.474401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-130847d3-2061-40ea-9010-7120c5eaf7ca tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1682 microversion: 2.1 time: 0.251485 Oct 04 12:07:22.475887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 226/458] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:22 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:23.514697 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:23.516036 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:23.528958 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:23.529866 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:23.530679 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:23.531953 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:23.532797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:23.533545 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:23.919483 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:23.928890 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-df9c6e95-839c-4b68-a93c-3876003cbc84 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1682 microversion: 2.1 time: 0.423143 Oct 04 12:07:23.929526 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 233/459] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:23 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:24.958548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:24.962279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:24.981189 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:24.986533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:24.986533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:24.990617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:24.992684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:24.993283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:25.354014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:25.364595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d80c4d7e-7a4f-4c27-a6a6-94e2c3371d43 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1682 microversion: 2.1 time: 0.413321 Oct 04 12:07:25.365544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 227/460] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:24 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1682 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:26.392940 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:26.394123 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:26.406507 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:26.407725 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:26.411186 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:26.413019 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:26.414157 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:26.415244 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:26.571441 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:26.589357 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-cb97dba4-46d4-42fe-bb19-bc36e50cb8b0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1615 microversion: 2.1 time: 0.203382 Oct 04 12:07:26.590434 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 234/461] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:26 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1615 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:26.923624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-0061f8ba-112b-42e5-9577-71f302a72116 req-7df8d0fd-4c39-48d1-9767-c0caee8de42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd8bd8a-3940-41fa-9d04-8d64e5932dff", "name": "network-vif-deleted", "tag": "d14fe48b-a81b-4523-a16a-7bc4020e7d73"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:26.932118 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=46 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:26.939953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-0061f8ba-112b-42e5-9577-71f302a72116 req-7df8d0fd-4c39-48d1-9767-c0caee8de42d service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:26.939953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-0061f8ba-112b-42e5-9577-71f302a72116 req-7df8d0fd-4c39-48d1-9767-c0caee8de42d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:26.939953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-0061f8ba-112b-42e5-9577-71f302a72116 req-7df8d0fd-4c39-48d1-9767-c0caee8de42d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:26.954521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-0061f8ba-112b-42e5-9577-71f302a72116 req-7df8d0fd-4c39-48d1-9767-c0caee8de42d service nova] Creating event network-vif-deleted:d14fe48b-a81b-4523-a16a-7bc4020e7d73 for instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff on hv-cinder-86021 Oct 04 12:07:26.961570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-0061f8ba-112b-42e5-9577-71f302a72116 req-7df8d0fd-4c39-48d1-9767-c0caee8de42d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042019 Oct 04 12:07:26.967132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 228/462] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:07:27.619607 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:27.620674 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:27.632714 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:27.635716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:27.635716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:27.635716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:27.635716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:27.636569 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:27.744927 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:27.745471 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:27.745930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:27.746411 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.objects.instance [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'fault' on Instance uuid bbd8bd8a-3940-41fa-9d04-8d64e5932dff {{(pid=133084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:07:27.904662 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:27.914222 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-867fb584-1a4a-4678-84a2-9131c6e29d6c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1332 microversion: 2.1 time: 0.299531 Oct 04 12:07:27.934891 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 235/463] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:27 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1332 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:28.957727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:28.962847 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:29.001053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:29.003282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:29.005034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:29.007179 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:29.008649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:29.020369 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:29.105438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:29.106237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:29.108299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:29.108299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'fault' on Instance uuid bbd8bd8a-3940-41fa-9d04-8d64e5932dff {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:07:29.194342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:29.207642 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-333b8931-052d-4248-b08e-e6fbd81e3a5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 200 len: 1332 microversion: 2.1 time: 0.264305 Oct 04 12:07:29.208554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 229/464] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:28 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 1332 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:30.234615 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:30.237133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:30.246993 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:30.248561 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:30.249359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:30.250481 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:30.252152 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:30.253150 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:30.274311 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.wsgi [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: request: GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff HTTP/1.1 Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept: application/json Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept-Encoding: identity Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Connection: close Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Length: 0 Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Type: application/json Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Host: 10.222.0.15 Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Openstack-System-Scope: None Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: User-Agent: python-urllib3/1.26.12 Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Id: None Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Name: None Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Identity-Status: Confirmed Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Is-Admin-Project: True Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Id: default Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Name: Default Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Role: reader,member Oct 04 12:07:30.276879 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Roles: reader,member Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Id: default Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Name: Default Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: method: > Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: exception: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:07:30.278516 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: action_args: {'id': 'bbd8bd8a-3940-41fa-9d04-8d64e5932dff'} Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:07:30.279406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:07:30.281081 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:30.283674 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. {{(pid=133084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:07:30.284756 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-f2e3cd14-27c6-4292-a5f8-930023935487 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 404 len: 111 microversion: 2.1 time: 0.057421 Oct 04 12:07:30.289751 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 236/465] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:30 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:07:30.299837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-782f538c-885f-4b33-a56e-df1162cc0b21 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '.version_select at 0x7f10c3728430>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:30.421051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-782f538c-885f-4b33-a56e-df1162cc0b21 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180181464" status: 202 len: 0 microversion: 2.1 time: 0.129262 Oct 04 12:07:30.422209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 230/466] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Oct 4 12:07:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180181464 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:07:31.848054 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-4c33eef8-dd2c-4c90-84f3-75e57c0de110 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Action: 'create', calling method: .version_select at 0x7f10c3898b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-129740318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcpN97pvIu0yvN0RsphyoS/yGElKUAeejKQhTyhVmluf4jq+U3E7aii3ZAkddfbF6if5vAvd4iUAaYQQt2CZPzVC7C5+B9XAVjWlieiZNKIHuaHNaEmw32zaA4DYB2ouQ=="}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:31.869109 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-4c33eef8-dd2c-4c90-84f3-75e57c0de110 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Getting quotas for project 037b4d6af496475da87a47a9fd8d438d. Resources: {'key_pairs'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:07:31.874353 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-4c33eef8-dd2c-4c90-84f3-75e57c0de110 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Getting quotas for user c7340e91e66f41559bb41e620ad3229f and project 037b4d6af496475da87a47a9fd8d438d. Resources: {'key_pairs'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:07:31.988486 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-4c33eef8-dd2c-4c90-84f3-75e57c0de110 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.465247 Oct 04 12:07:31.989472 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 237/467] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:07:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:07:32.244518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:32.245316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:32.260289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:32.261213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:32.261986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:32.263316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:32.264309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:32.265088 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:32.549988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'services' on Instance uuid fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:07:32.877600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-caa51ba9-c76a-4ebb-96e6-7f848389f750 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments/af67dc62-9bea-4aa5-bce4-5c3512d1657c" status: 202 len: 0 microversion: 2.1 time: 0.641170 Oct 04 12:07:32.878631 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 231/468] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:07:32 2022] DELETE /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments/af67dc62-9bea-4aa5-bce4-5c3512d1657c => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:07:32.890915 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:32.895136 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:32.906347 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:32.907346 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:32.908152 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:32.909225 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:32.910131 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:32.910794 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:32.979614 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b46a6312-337c-4dab-80b2-0627c1b64506 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065646 Oct 04 12:07:32.979614 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 238/469] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:07:32 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:07:33.992599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:33.995871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:34.003381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:34.003923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:34.004409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:34.005135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:34.005596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:34.006046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:34.009109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:34.066318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e972d107-94cf-4c37-a09a-3fe0cb291714 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078997 Oct 04 12:07:34.067899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 232/470] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:07:33 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:35.082884 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:35.086171 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:35.096078 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:35.096930 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:35.097977 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:35.099266 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:35.099981 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:35.100681 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:35.138820 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-72b2c004-55c8-4de1-9073-8dba49ba3fee tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061146 Oct 04 12:07:35.139430 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 239/471] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:07:35 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:36.152633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:36.154848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:36.165232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:36.166070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:36.166772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:36.168040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:36.168829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:36.169683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:36.209940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d326b826-b7d2-49a9-b2c7-ca39fdede458 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062102 Oct 04 12:07:36.210633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 233/472] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:07:36 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 12:07:36.292762 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:36.293634 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:36.307663 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:36.308421 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:36.308974 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:36.309915 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:36.310478 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:36.311104 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:36.362005 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Going to try to terminate instance {{(pid=133084) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:07:36.809505 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-dbec910e-72be-4e9a-898d-15c1aa1af22b tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 204 len: 0 microversion: 2.1 time: 0.520771 Oct 04 12:07:36.810508 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 240/473] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:07:36 2022] DELETE /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:07:36.838261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:36.839042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:36.846895 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:36.847400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:36.847844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:36.848599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:36.849055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:36.849480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:37.007371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:37.017439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b7a13fc7-33e7-4afc-835c-457f6a0c3c8d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1679 microversion: 2.1 time: 0.184205 Oct 04 12:07:37.018169 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 234/474] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:36 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:38.043920 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:38.044824 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:38.051957 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:38.052419 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:38.053409 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:38.054138 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:38.054600 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:38.055031 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:38.343174 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:38.353394 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-2a8f9c52-903f-476d-823e-5abb218a26d8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1679 microversion: 2.1 time: 0.313859 Oct 04 12:07:38.353996 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 241/475] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:38 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1679 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:39.380395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:39.381078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:39.388502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:39.388980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:39.389429 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:39.390150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:39.390604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:39.391069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:39.568465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:39.577284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e950e076-b54c-4e21-a668-ed57c36d9257 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1679 microversion: 2.1 time: 0.201261 Oct 04 12:07:39.578075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 235/476] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:39 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:40.606334 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:40.608734 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:40.623207 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:40.624533 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:40.625797 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:40.630002 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:40.631372 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:40.632106 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:40.666800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-b465e1fa-55cd-4866-8709-e40fd6f45136 req-82a27ab5-ad31-47bd-9489-7b2eb2d07d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b", "name": "network-vif-deleted", "tag": "39184605-6fa0-4bf3-b70f-59aac0ab9b51"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:40.714165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b465e1fa-55cd-4866-8709-e40fd6f45136 req-82a27ab5-ad31-47bd-9489-7b2eb2d07d6f service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:40.715864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b465e1fa-55cd-4866-8709-e40fd6f45136 req-82a27ab5-ad31-47bd-9489-7b2eb2d07d6f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:40.716850 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b465e1fa-55cd-4866-8709-e40fd6f45136 req-82a27ab5-ad31-47bd-9489-7b2eb2d07d6f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:40.748061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-b465e1fa-55cd-4866-8709-e40fd6f45136 req-82a27ab5-ad31-47bd-9489-7b2eb2d07d6f service nova] Creating event network-vif-deleted:39184605-6fa0-4bf3-b70f-59aac0ab9b51 for instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b on hv-cinder-86021 Oct 04 12:07:40.762912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-b465e1fa-55cd-4866-8709-e40fd6f45136 req-82a27ab5-ad31-47bd-9489-7b2eb2d07d6f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101979 Oct 04 12:07:40.766768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 236/477] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:40.799001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:40.799001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-1a78ec11-b673-4caa-a745-d3bf8a0e9d12 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1611 microversion: 2.1 time: 0.188990 Oct 04 12:07:40.799001 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 242/478] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:40 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1611 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:41.833632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:41.834452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:41.842172 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:41.843036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:41.843655 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:41.844718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:41.845221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:41.845646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:41.883455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:41.884260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:41.884628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:41.888538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'fault' on Instance uuid fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:07:41.945666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:41.955127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-056cf2df-0ccb-4f26-9a77-17a4c43e7732 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 200 len: 1330 microversion: 2.1 time: 0.125822 Oct 04 12:07:41.956224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 237/479] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:41 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:42.091366 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:42.095746 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:42.100389 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=4 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:42.108100 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:42.108850 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:42.109664 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:42.110331 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:42.111144 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:42.111530 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:42.509159 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-697d48ff-dfc8-40cc-8eec-58b058ce715b tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/action" status: 202 len: 0 microversion: 2.1 time: 0.424273 Oct 04 12:07:42.510180 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 243/480] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:07:42 2022] POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:07:42.520099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:42.520941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:42.530962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:42.531715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:42.532539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:42.533726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:42.534360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:42.535496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:42.744456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:42.756379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4ad1a008-ae62-491a-a598-45e1f8ece57f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1752 microversion: 2.1 time: 0.240520 Oct 04 12:07:42.757339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 238/481] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:42 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1752 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:42.990412 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:42.991811 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:43.002334 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:43.002910 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:43.003521 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:43.004404 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:43.005071 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:43.005809 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:43.026820 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.wsgi [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: request: GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b HTTP/1.1 Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept: application/json Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Accept-Encoding: identity Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Connection: close Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Length: 0 Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Content-Type: application/json Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Host: 10.222.0.15 Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Openstack-System-Scope: None Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: User-Agent: python-urllib3/1.26.12 Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Id: None Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Domain-Name: None Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Identity-Status: Confirmed Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Is-Admin-Project: True Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Id: default Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Domain-Name: Default Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Role: reader,member Oct 04 12:07:43.028851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Roles: reader,member Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Id: default Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Domain-Name: Default Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: method: > Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: exception: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:07:43.031716 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: action_args: {'id': 'fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b'} Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:07:43.033198 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:07:43.035667 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack.wsgi Oct 04 12:07:43.038374 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. {{(pid=133084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:07:43.038374 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b606449b-66e6-45e2-a872-5bbdc6649f18 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 404 len: 111 microversion: 2.1 time: 0.049123 Oct 04 12:07:43.038374 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 244/482] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:42 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:07:43.045630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-20fa6e02-5234-40ed-a1ce-a0276f7cc866 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '.version_select at 0x7f10c37de280>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:43.152239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-20fa6e02-5234-40ed-a1ce-a0276f7cc866 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887160329" status: 202 len: 0 microversion: 2.1 time: 0.111501 Oct 04 12:07:43.153028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 239/483] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Oct 4 12:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887160329 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:07:43.787219 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:43.788578 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:43.801092 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:43.801913 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:43.803083 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:43.804262 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:43.805009 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:43.805658 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:43.837778 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:44.119633 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:44.131216 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-fc54d23f-1abf-4d27-92d7-f9414629298d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.350094 Oct 04 12:07:44.138041 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 245/484] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:43 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:44.187481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ca1a363f-136b-41dd-a37d-62cd31feb9c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: .version_select at 0x7f10c3729af0>, body: {"keypair": {"name": "tempest-keypair-94192657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhbrrsDMTJQB3uV872t1PH3tiPe0tZ3DmRQhJS7RD/M8DcACTNrerk5+1/Jk1A4gX7DJXdCFnH4E2Up+Yg7sJwBTXqKUrTTzZtyF2CiDvhvPdblp5DnhqztzxJ2bq2rwA=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:44.209297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-ca1a363f-136b-41dd-a37d-62cd31feb9c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:07:44.214781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-ca1a363f-136b-41dd-a37d-62cd31feb9c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:07:44.311248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ca1a363f-136b-41dd-a37d-62cd31feb9c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.130221 Oct 04 12:07:44.311862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 240/485] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:07:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:45.155297 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:45.156153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:45.163675 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:45.164157 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:45.164628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:45.165346 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:45.165803 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:45.166314 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:45.353906 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:45.370549 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-3ef66aae-ae4b-48d7-81d7-c4ba46c8bbb1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.218849 Oct 04 12:07:45.371914 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 246/486] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:45 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:46.412581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:46.413559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:46.422876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:46.423419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:46.423863 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:46.424829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:46.425719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:46.425719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:46.622545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:46.633800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5ccac918-7fa3-42ac-938c-1e1b1d2a447e tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.226462 Oct 04 12:07:46.634389 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 241/487] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:46 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:47.417000 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-524713151", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a843603-1123-4e00-9b28-113fe25ca6eb"}], "security_groups": [{"name": "tempest-securitygroup--1256135808"}], "key_name": "tempest-keypair-94192657", "user_data": "}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:47.556484 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] validate_networks() for [('6a843603-1123-4e00-9b28-113fe25ca6eb', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:07:47.660365 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:47.661208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:47.670972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:47.671556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:47.672145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:47.673234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:47.673875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:47.674403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:47.867534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:47.877923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-57d9270b-f67f-45e5-83f1-adf554cfb3c8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.223557 Oct 04 12:07:47.878557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 242/488] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:47 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:48.035421 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:07:48.035841 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image limits 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:07:48.036343 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:07:48.036783 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image pref 0:0:0 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:07:48.037195 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.virt.hardware [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:07:48.047009 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:48.047514 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:48.047922 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:48.048705 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:48.049153 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:48.049577 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:48.070577 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:07:48.075364 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.quota [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:07:48.089288 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Going to run 1 instances... {{(pid=133084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:07:48.091925 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:07:48.427254 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-aa777d13-9bdd-4cc5-9c77-b87012e607c6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.021561 Oct 04 12:07:48.428020 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 247/489] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:07:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:07:48.547718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ecc088ba-fd2f-4d15-b35c-830be38d03db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:48.548659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ecc088ba-fd2f-4d15-b35c-830be38d03db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:48.638279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ecc088ba-fd2f-4d15-b35c-830be38d03db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:48.648145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ecc088ba-fd2f-4d15-b35c-830be38d03db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1239 microversion: 2.1 time: 0.211416 Oct 04 12:07:48.649100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 243/490] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:48 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1239 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:48.908165 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:48.908956 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:48.917252 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:48.917855 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:48.918968 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:48.919523 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:48.920034 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:48.920617 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:49.108015 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:49.119499 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-cd2bfa29-86f6-44bc-8b71-a766448726a0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.216697 Oct 04 12:07:49.120358 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 248/491] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:48 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:49.678318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:49.678926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:49.687305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:49.687837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:49.688308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:49.689021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:49.689476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:49.689898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:49.770031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:49.779007 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-686a5232-9af7-4ee6-b69b-472492f8b246 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1243 microversion: 2.1 time: 0.104839 Oct 04 12:07:49.779667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 244/492] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:49 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1243 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:50.151653 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:50.152866 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:50.160593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:50.161097 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:50.161554 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:50.162358 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:50.162831 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:50.163339 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:50.380316 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:50.395076 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-5b36cc7a-17bc-46a9-bcfc-b42b83f3deb6 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.246973 Oct 04 12:07:50.396494 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 249/493] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:50 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:50.807607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:50.808821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:50.820537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:50.821383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:50.822173 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:50.823643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:50.824504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:50.825257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:50.919383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:50.928404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-10a2de5b-e64d-49af-bb36-f06aae833857 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1291 microversion: 2.1 time: 0.128136 Oct 04 12:07:50.929066 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 245/494] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:50 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1291 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:51.425799 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:51.427490 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:51.439533 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:51.440462 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:51.441265 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:51.442658 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:51.444104 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:51.444349 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:51.757564 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:51.779091 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-d0ba50cf-7e4c-483b-b7ba-049647377f4d tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.360471 Oct 04 12:07:51.797436 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 250/495] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:51 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:51.968439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:51.969973 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:51.977213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:51.977623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:51.978068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:51.978890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:51.979350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:51.979785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:52.052946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:52.062263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-075865f0-2c19-4468-9869-9c1dd00965e9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1297 microversion: 2.1 time: 0.098029 Oct 04 12:07:52.062864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 246/496] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:51 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:52.819640 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:52.820257 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:52.824268 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:52.840904 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:52.840904 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:52.840904 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:52.840904 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:52.841603 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:52.841603 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:53.102633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:53.116440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:53.116440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:53.116440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:53.116440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:53.116828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:53.116828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:53.116828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:53.283079 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:53.292923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-929798e3-c485-4b44-8cc0-6c68ff521801 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.195951 Oct 04 12:07:53.293519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 247/497] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:53 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:53.336026 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:53.345097 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-cf686141-0841-4687-8c67-180856f7a8e5 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.529517 Oct 04 12:07:53.345950 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 251/498] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:52 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:54.110411 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-31414ad4-5290-4510-b810-0b977a3d2c68 req-4ee4f65c-c7bf-4164-a2f8-c07c37697d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0314f45-1648-422f-9456-e64956b6ad32", "tag": "386857ff-677e-4c78-8e4f-9bfd1ad1be0b"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:07:54.131754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-31414ad4-5290-4510-b810-0b977a3d2c68 req-4ee4f65c-c7bf-4164-a2f8-c07c37697d8b service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:54.137522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-31414ad4-5290-4510-b810-0b977a3d2c68 req-4ee4f65c-c7bf-4164-a2f8-c07c37697d8b service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:54.137522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-31414ad4-5290-4510-b810-0b977a3d2c68 req-4ee4f65c-c7bf-4164-a2f8-c07c37697d8b service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:54.156521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-31414ad4-5290-4510-b810-0b977a3d2c68 req-4ee4f65c-c7bf-4164-a2f8-c07c37697d8b service nova] Creating event network-changed:386857ff-677e-4c78-8e4f-9bfd1ad1be0b for instance f0314f45-1648-422f-9456-e64956b6ad32 on hv-cinder-86021 Oct 04 12:07:54.165349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-31414ad4-5290-4510-b810-0b977a3d2c68 req-4ee4f65c-c7bf-4164-a2f8-c07c37697d8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062804 Oct 04 12:07:54.166461 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 248/499] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:07:54.320639 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:54.321511 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:54.328250 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:54.329040 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:54.329553 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:54.330383 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:54.330921 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:54.331435 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:54.375249 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:54.375880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:54.384591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:54.385087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:54.385814 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:54.387054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:54.387860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:54.388716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:54.617455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:54.628919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e469e35c-99da-4bdf-a402-b1eb3f8f8426 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.257985 Oct 04 12:07:54.629691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 249/500] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:54 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:54.636949 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:54.646714 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-ca48b37f-8c67-4b4a-9e93-7ef5bae2f51f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.330625 Oct 04 12:07:54.647488 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 252/501] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:54 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:55.667516 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:55.668649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:55.671424 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:55.672326 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:55.678583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:55.679219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:55.680049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:55.681238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:55.681841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:55.682160 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:55.682492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:55.682972 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:55.683719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:55.684775 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:55.685350 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:55.685902 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:55.880919 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:55.895183 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-e4707804-d24b-44c1-90cb-9afe4e892e0f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.228239 Oct 04 12:07:55.895561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:55.895976 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 253/502] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:55 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:55.905437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-52d5b715-89c3-4243-b7d1-6ff322596515 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.243210 Oct 04 12:07:55.906038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 250/503] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:55 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:56.928137 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:56.929326 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:56.931673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:56.932528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:56.937590 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:56.938073 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:56.938526 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:56.939251 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:56.939707 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:56.940133 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:56.940872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:56.941441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:56.941950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:56.942867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:56.943534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:56.944029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:57.105212 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:57.113812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-60679c84-38bd-4d32-b7ac-6ecc9ca6c588 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.190505 Oct 04 12:07:57.115150 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 254/504] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:56 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:57.119881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:57.134373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1434dcdb-9370-414c-bd77-c12b9c1d50f1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.208003 Oct 04 12:07:57.135196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 251/505] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:56 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:58.139126 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:58.139877 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:58.142359 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=2 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:58.143095 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell0:SELECT=6 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:58.148273 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:58.149028 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:58.149565 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:58.150332 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:58.150850 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:58.151311 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:58.159555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:58.160685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:58.169346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:58.169844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:58.170281 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:58.170995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:58.171447 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:58.171868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:58.326109 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:58.341399 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-b0385ace-df38-45c7-8722-ec204075d7d7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.205930 Oct 04 12:07:58.342594 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 255/506] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:58 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:58.382553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:58.385026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:58.395732 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1aa52f81-031d-49bc-9b78-dfcedee0a740 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.236910 Oct 04 12:07:58.395732 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 252/507] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:58 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:07:59.383901 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:59.385082 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:59.395164 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:59.396542 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:59.397324 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:59.398597 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:59.399488 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:59.400348 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:59.420804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:07:59.421649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:07:59.425528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=6 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:59.426818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:07:59.431485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:59.432486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:59.433061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:59.433927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:07:59.434557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:07:59.435159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:07:59.619418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:59.630474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e25e7a90-f540-436b-8c3d-8c0396852ad1 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.213492 Oct 04 12:07:59.631251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 253/508] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:59 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:07:59.643591 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:07:59.655113 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-105f6fdf-9e29-4fe9-9b61-a0fcd4004218 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.277838 Oct 04 12:07:59.655750 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 256/509] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:07:59 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:00.655610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:00.656339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:00.663898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:00.664441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:00.664893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:00.665613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:00.666073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:00.666504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:00.681241 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:00.682160 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.compute.api [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133084) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:00.691867 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:00.693628 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:00.694683 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:00.696301 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:00.697342 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:00.698056 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG oslo_concurrency.lockutils [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:00.863445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:00.880734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-289d16c1-a116-4cfe-8418-31e1bfb8b968 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.228566 Oct 04 12:08:00.888616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 254/510] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:00 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:00.895959 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.policy [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133084) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:00.904604 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-0cdfa1c8-4b93-4118-a4f3-ef7ee44b07a0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.227904 Oct 04 12:08:00.905213 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 257/511] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:00 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:01.374237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-ffcc8381-6b0f-4863-8431-6d812e1061aa req-a7ae2090-3739-4093-a1ff-d39f4004338c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0314f45-1648-422f-9456-e64956b6ad32", "name": "network-vif-plugged", "status": "completed", "tag": "386857ff-677e-4c78-8e4f-9bfd1ad1be0b"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:01.392855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ffcc8381-6b0f-4863-8431-6d812e1061aa req-a7ae2090-3739-4093-a1ff-d39f4004338c service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:01.393695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ffcc8381-6b0f-4863-8431-6d812e1061aa req-a7ae2090-3739-4093-a1ff-d39f4004338c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:01.394487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ffcc8381-6b0f-4863-8431-6d812e1061aa req-a7ae2090-3739-4093-a1ff-d39f4004338c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:01.416662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-ffcc8381-6b0f-4863-8431-6d812e1061aa req-a7ae2090-3739-4093-a1ff-d39f4004338c service nova] Creating event network-vif-plugged:386857ff-677e-4c78-8e4f-9bfd1ad1be0b for instance f0314f45-1648-422f-9456-e64956b6ad32 on hv-cinder-86021 Oct 04 12:08:01.426018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-ffcc8381-6b0f-4863-8431-6d812e1061aa req-a7ae2090-3739-4093-a1ff-d39f4004338c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058014 Oct 04 12:08:01.428136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 255/512] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:08:01.504616 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1522788111", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-129740318", "security_groups": [{"name": "tempest-secgroup-smoke-548429490"}], "networks": [{"uuid": "b3b93906-ff69-47aa-a22a-9f133e9568f9"}], "block_device_mapping_v2": [{"uuid": "8c670007-e3a3-4a93-9ce8-340d6e07a5ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=133084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:01.679807 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.network.neutron [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] validate_networks() for [('b3b93906-ff69-47aa-a22a-9f133e9568f9', None, None, None, None, None)] {{(pid=133084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:08:01.924329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:01.925631 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:01.942998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:01.942998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:01.942998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:01.942998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:01.943670 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:01.944030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:02.146011 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:02.154770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d393b6b4-28b8-40b8-99f7-7f16db76a6f7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.239304 Oct 04 12:08:02.155370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 256/513] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:01 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:02.161189 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:02.161654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:02.168439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:02.168942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:02.169543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:02.170275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:02.170735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:02.171166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:02.331584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:02.341074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4029e963-656c-4539-b637-85de9486e1cc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.184518 Oct 04 12:08:02.341831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 257/514] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:02 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:03.179821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:03.180754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:03.188139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:03.188685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:03.189126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:03.189915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:03.190372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:03.190800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:03.353415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:03.363503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ceac650d-f85c-46b7-a482-fa4f45a1e2a7 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.188198 Oct 04 12:08:03.366311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 258/515] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:03 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:03.370148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:03.370777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:03.378015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:03.378509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:03.378954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:03.379721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:03.380193 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:03.380642 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:03.549991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:03.565743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b25a7e13-ce07-490d-8db0-d92ed00d493c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.199421 Oct 04 12:08:03.567375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 259/516] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:03 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:04.390998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:04.391865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:04.398926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:04.399421 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:04.399851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:04.400679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:04.401130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:04.401598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:04.565227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:04.575578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2fb8fd59-e8ec-4c13-8531-ed897aab2698 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.188622 Oct 04 12:08:04.576273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 260/517] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:04 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:04.601102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:04.601777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:04.608525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:04.609015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:04.609448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:04.610151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:04.610603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:04.611128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:04.783158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:04.794040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-74371bb0-a057-466b-ae54-8c16b17e1adb tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1365 microversion: 2.1 time: 0.196807 Oct 04 12:08:04.795635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 261/518] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:04 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:05.601063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:05.601802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:05.609206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:05.611135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:05.611135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:05.611135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:05.611414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:05.611782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:05.782336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:05.796664 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-51f18c8f-68cc-4b2e-b858-8437ce222f30 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1757 microversion: 2.1 time: 0.199920 Oct 04 12:08:05.797746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 262/519] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:05 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:05.819364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:05.819985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:05.826918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:05.827416 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:05.827852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:05.828814 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:05.829309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:05.829738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:05.981805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:05.990605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a6e6957b-6ae2-49d6-8dfb-c70be0f0bfd8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1554 microversion: 2.1 time: 0.175350 Oct 04 12:08:05.991203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 263/520] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:05 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:06.013751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:06.014258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:06.021337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:06.021832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:06.022265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:06.023011 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:06.023470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:06.023928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:06.116495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-81dc3c61-0608-476c-a8aa-4658061d0581 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106647 Oct 04 12:08:06.117106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 264/521] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:08:06 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:08:06.822096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:06.822926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:06.829755 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:06.830256 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:06.830704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:06.831459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:06.832026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:06.832503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:07.015171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:07.024350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-64378edb-7e27-4ca6-9182-cf5465916b69 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1760 microversion: 2.1 time: 0.207052 Oct 04 12:08:07.024949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 265/522] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:06 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1760 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:07.629002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-bd373093-83da-4c00-8d30-aa328c8b1c13 req-b856abc3-a221-4607-bc52-43517e86bfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0314f45-1648-422f-9456-e64956b6ad32", "tag": "386857ff-677e-4c78-8e4f-9bfd1ad1be0b"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:07.640693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-bd373093-83da-4c00-8d30-aa328c8b1c13 req-b856abc3-a221-4607-bc52-43517e86bfc8 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:07.641329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-bd373093-83da-4c00-8d30-aa328c8b1c13 req-b856abc3-a221-4607-bc52-43517e86bfc8 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:07.641885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-bd373093-83da-4c00-8d30-aa328c8b1c13 req-b856abc3-a221-4607-bc52-43517e86bfc8 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:07.656511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-bd373093-83da-4c00-8d30-aa328c8b1c13 req-b856abc3-a221-4607-bc52-43517e86bfc8 service nova] Creating event network-changed:386857ff-677e-4c78-8e4f-9bfd1ad1be0b for instance f0314f45-1648-422f-9456-e64956b6ad32 on hv-cinder-86021 Oct 04 12:08:07.663487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-bd373093-83da-4c00-8d30-aa328c8b1c13 req-b856abc3-a221-4607-bc52-43517e86bfc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038859 Oct 04 12:08:07.664254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 266/523] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:08:10.900740 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_cell1:SELECT=70 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:11.529520 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG dbcounter [-] [133084] Writing DB stats nova_api:SELECT=15 {{(pid=133084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:17.223284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:17.225920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:17.233166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:17.233909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:17.234463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:17.235327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:17.235843 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:17.236462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:17.270649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2f7b0d7f-9515-46e1-9738-a9c131eeb448 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053716 Oct 04 12:08:17.271245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 267/524] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:08:17 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 12:08:17.353187 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:17.353690 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:17.360301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:17.360811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:17.361272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:17.362014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:17.362474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:17.362903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:17.391897 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:08:17.705649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0830d1a1-a357-4ff3-9093-6b156572d12d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 204 len: 0 microversion: 2.1 time: 0.356474 Oct 04 12:08:17.706253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 268/525] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:08:17 2022] DELETE /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:08:17.716247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:17.716969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:17.723591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:17.724080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:17.724558 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:17.725363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:17.725819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:17.726245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:17.745511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:17.900889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:17.909747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e642cf4c-2633-4e67-a476-4c4cee149c65 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1672 microversion: 2.1 time: 0.197763 Oct 04 12:08:17.910354 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 269/526] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:17 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:18.952511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:18.953373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:18.961374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:18.961861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:18.962298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:18.963008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:18.963461 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:18.963879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:19.122272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:19.132052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-79d90c8e-64f6-4746-8b7e-7094ac8d4937 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1672 microversion: 2.1 time: 0.185462 Oct 04 12:08:19.132755 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 270/527] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:18 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:20.156332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:20.157413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:20.164129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:20.164684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:20.165240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:20.165919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:20.166386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:20.166813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:20.308116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:20.317422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3582a3d8-c3f6-4ec7-b24e-1e08c5baeef6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1672 microversion: 2.1 time: 0.165272 Oct 04 12:08:20.318015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 271/528] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:20 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:21.146180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6677180-dc19-448e-ab09-3197ef14120e"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:21.149322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:21.159375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:21.161225 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:21.162127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:21.163437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:21.164310 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:21.165088 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:22.219597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2433c507-180b-4948-bca2-d646aad18c63 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077586 Oct 04 12:08:22.222144 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 272/529] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:08:21 2022] POST /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:08:22.254808 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:22.258918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:22.272503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:22.273014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:22.273507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:22.274272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:22.275120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:22.275899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:22.349640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:22.350533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:22.351096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:22.351673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lazy-loading 'fault' on Instance uuid 889c6e11-6374-4ec0-aacc-addc853c945d {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:08:22.429960 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:22.454049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-139b3dc7-6e83-4d54-850e-90c8f363dc96 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 200 len: 1325 microversion: 2.1 time: 0.229114 Oct 04 12:08:22.455034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 273/530] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:22 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:22.576899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-6ed9a6ad-1a70-4748-82c8-3ffaafcaee22 req-1e51aafc-16f0-4a05-b2e3-adc3b463c49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889c6e11-6374-4ec0-aacc-addc853c945d", "name": "network-vif-deleted", "tag": "b1974f78-ed23-4d93-990a-dc57aca745ee"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:22.590836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6ed9a6ad-1a70-4748-82c8-3ffaafcaee22 req-1e51aafc-16f0-4a05-b2e3-adc3b463c49e service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:22.591679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6ed9a6ad-1a70-4748-82c8-3ffaafcaee22 req-1e51aafc-16f0-4a05-b2e3-adc3b463c49e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:22.592476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6ed9a6ad-1a70-4748-82c8-3ffaafcaee22 req-1e51aafc-16f0-4a05-b2e3-adc3b463c49e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:22.611868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-6ed9a6ad-1a70-4748-82c8-3ffaafcaee22 req-1e51aafc-16f0-4a05-b2e3-adc3b463c49e service nova] Creating event network-vif-deleted:b1974f78-ed23-4d93-990a-dc57aca745ee for instance 889c6e11-6374-4ec0-aacc-addc853c945d on hv-cinder-86021 Oct 04 12:08:22.618035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-6ed9a6ad-1a70-4748-82c8-3ffaafcaee22 req-1e51aafc-16f0-4a05-b2e3-adc3b463c49e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161066 Oct 04 12:08:22.618863 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 274/531] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:08:23.482049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:23.482852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:23.491425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:23.494002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:23.494002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:23.494002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:23.494002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:23.494506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:23.509716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] HTTP exception thrown: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Request method failure captured: Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d HTTP/1.1 Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDiP7Pj4b4fPcuDvnXmdKT8_Zw7UloUTZVYYO_vN_na7Xm9gU2HzCQHlozQxbIVdg6fqmGPa30U6IDP4QKmcky4T-EDBa55aT-NsCarxllU9JbdJv6JaPB9-vamwc6P-v9Ck4Y-fvj5dUdwf5eoa6axQm6_LGU5ELY7rPf1pbf_0ig Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:08:23.511577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4eb043e789a6467db5465a0107f41076", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}] Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fd040e13fd6c4b0dbea6a65932f84cb2 Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:08:23.513941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '889c6e11-6374-4ec0-aacc-addc853c945d'} Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:08:23.514842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:08:23.516443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:08:23.518340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Returning 404 to user: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:08:23.518340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8a1eae5a-d893-4e01-af16-472a3114bffc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 404 len: 111 microversion: 2.1 time: 0.036459 Oct 04 12:08:23.518340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 275/532] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:23 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:08:23.523251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-38b9732e-cebc-41e0-937b-c071e86d430c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '.version_select at 0x7f10c39454c0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:23.630797 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-38b9732e-cebc-41e0-937b-c071e86d430c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717718773" status: 202 len: 0 microversion: 2.1 time: 0.111959 Oct 04 12:08:23.631576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 276/533] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Oct 4 12:08:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717718773 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:08:24.573702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6f9a71bb-3caf-4c47-8a81-16782dcf601c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'create', calling method: .version_select at 0x7f10c36d8ca0>, body: {"keypair": {"name": "tempest-keypair-1501637330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNEsIBUmRPrgbZHovXD3tfWSzBBvGTle79rKmSHcv2ExFSWFu29i4GLwtJ2mPPqDllfZTWTdloRa/GdgekYd08GhkPPfQ6P0OsTF32Xa2sIWICrdB50W0jBgJ2lWHEafg=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:24.592932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-6f9a71bb-3caf-4c47-8a81-16782dcf601c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for project 4eb043e789a6467db5465a0107f41076. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:08:24.598183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-6f9a71bb-3caf-4c47-8a81-16782dcf601c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for user fd040e13fd6c4b0dbea6a65932f84cb2 and project 4eb043e789a6467db5465a0107f41076. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:08:24.690547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6f9a71bb-3caf-4c47-8a81-16782dcf601c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121839 Oct 04 12:08:24.691112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 277/534] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:08:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:08:27.780714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-357975502", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d8166dc-91eb-4754-a625-1f72bd32d0b4"}], "security_groups": [{"name": "tempest-securitygroup--996768383"}], "key_name": "tempest-keypair-1501637330", "user_data": "}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:27.908570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] validate_networks() for [('1d8166dc-91eb-4754-a625-1f72bd32d0b4', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:08:28.441612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:08:28.442142 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:08:28.443348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:08:28.443985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:08:28.444535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:08:28.461253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:28.462132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:28.462940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:28.464386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:28.465251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:28.466045 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:28.497951 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for project 4eb043e789a6467db5465a0107f41076. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:08:28.506739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Getting quotas for user fd040e13fd6c4b0dbea6a65932f84cb2 and project 4eb043e789a6467db5465a0107f41076. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:08:28.523461 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:08:28.526485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:08:28.663015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2f634fea-968a-424a-aca3-94a1b8e40c9d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.888488 Oct 04 12:08:28.663677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 278/535] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:08:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:08:28.680488 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5d758b85-c74c-4ae9-8e4e-4e02756010f0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:28.681182 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5d758b85-c74c-4ae9-8e4e-4e02756010f0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:28.808900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5d758b85-c74c-4ae9-8e4e-4e02756010f0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:28.822604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5d758b85-c74c-4ae9-8e4e-4e02756010f0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1237 microversion: 2.1 time: 0.146076 Oct 04 12:08:28.833351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 279/536] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:28 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1237 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:29.864569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-241d3bf0-d9be-4305-87b5-76d97cf4a254 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:29.865719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-241d3bf0-d9be-4305-87b5-76d97cf4a254 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:29.925895 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-241d3bf0-d9be-4305-87b5-76d97cf4a254 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:29.940621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-241d3bf0-d9be-4305-87b5-76d97cf4a254 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1237 microversion: 2.1 time: 0.080513 Oct 04 12:08:29.941706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 280/537] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:29 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:30.968686 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:30.970165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:30.978249 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:30.978898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:30.979483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:30.980422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:30.980945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:30.981598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:31.055984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:31.063037 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a1231859-052e-42a7-b17e-4259d67c2061 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1289 microversion: 2.1 time: 0.099917 Oct 04 12:08:31.063992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 281/538] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:30 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:31.070076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:31.072604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:31.079641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:31.080139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:31.080624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:31.081924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:31.082348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:31.082781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:31.126384 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lazy-loading 'flavor' on Instance uuid 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:08:31.552662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e0199996-e6ee-476e-8eba-40a0d94b248f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/action" status: 200 len: 32 microversion: 2.1 time: 0.487322 Oct 04 12:08:31.553299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 282/539] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:08:31 2022] POST /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/action => generated 32 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:08:31.563953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:31.565598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:31.566786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:31.582437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:31.582933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:31.583380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:31.584106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:31.584601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:31.585031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:31.750261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:31.761530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-53256829-210b-43f2-80ae-a75de49168c6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.201862 Oct 04 12:08:31.762224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 283/540] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:31 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:32.098716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:32.100130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:32.112565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:32.113455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:32.114535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:32.116081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:32.116927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:32.117775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:32.212125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:32.221923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-911fcab3-0cbd-42f5-91e2-8708ea88be35 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1297 microversion: 2.1 time: 0.131465 Oct 04 12:08:32.222532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 284/541] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:32 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1297 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:32.791480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:32.794357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:32.820467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:32.820467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:32.820467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:32.820467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:32.821207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:32.821207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:33.029047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:33.047788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2f49ee63-f4d7-4cc4-9faa-f3b4238e287d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.262182 Oct 04 12:08:33.049270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 285/542] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:32 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:33.261838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:33.262849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:33.269902 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:33.270591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:33.271090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:33.271972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:33.272678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:33.273283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:33.468536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:33.482946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-454276ed-9ae0-4a1d-ad2a-ae0f90a7add4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.224644 Oct 04 12:08:33.483827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 286/543] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:33 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:34.085717 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:34.086414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:34.095476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:34.096872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:34.097995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:34.099409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:34.100361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:34.104776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:34.284636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:34.301558 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9d0f3d8b-6803-47a7-9fc6-cade6f9c8783 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.220160 Oct 04 12:08:34.302674 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 287/544] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:34 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:34.521856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:34.523199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:34.530491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:34.530989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:34.531430 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:34.532150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:34.532642 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:34.533073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:34.549678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:34.746001 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:34.761480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0f89ea5d-9f7c-4eb2-b25e-fea2881f62b5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.242982 Oct 04 12:08:34.762547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 288/545] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:34 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:34.771096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-e8e692b7-adfa-4f84-997f-3227f2a6d8fd req-80e70e20-c97c-4179-9302-9e620fa54af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b3f870-4de4-4585-98ce-77ea122df015", "tag": "37e28375-5f84-47c0-8196-4faed5327646"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:34.786589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e8e692b7-adfa-4f84-997f-3227f2a6d8fd req-80e70e20-c97c-4179-9302-9e620fa54af7 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:34.787070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e8e692b7-adfa-4f84-997f-3227f2a6d8fd req-80e70e20-c97c-4179-9302-9e620fa54af7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:34.787741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e8e692b7-adfa-4f84-997f-3227f2a6d8fd req-80e70e20-c97c-4179-9302-9e620fa54af7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:34.801061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-e8e692b7-adfa-4f84-997f-3227f2a6d8fd req-80e70e20-c97c-4179-9302-9e620fa54af7 service nova] Creating event network-changed:37e28375-5f84-47c0-8196-4faed5327646 for instance 22b3f870-4de4-4585-98ce-77ea122df015 on hv-cinder-86021 Oct 04 12:08:34.807006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-e8e692b7-adfa-4f84-997f-3227f2a6d8fd req-80e70e20-c97c-4179-9302-9e620fa54af7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042380 Oct 04 12:08:34.807138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 289/546] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:08:35.343349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:35.344414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:35.351906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:35.352616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:35.353160 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:35.353986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:35.354565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:35.355385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:35.532608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:35.543240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-842cb30a-8395-4280-aafd-fe68ead757b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.205104 Oct 04 12:08:35.543859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 290/547] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:35 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:35.785681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:35.786512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:35.794274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:35.794901 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:35.795522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:35.796453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:35.797016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:35.797543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:35.976073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:35.984685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-287fa79f-3cbb-4035-b4ae-0e094ac039b9 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.203465 Oct 04 12:08:35.985278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 291/548] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:35 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:36.567442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:36.568408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:36.575521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:36.576012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:36.576476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:36.577185 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:36.577637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:36.578091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:36.728641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:36.738136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ff4ac5f7-b0fd-4696-a62b-f29a8799e92c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.174819 Oct 04 12:08:36.738738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 292/549] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:36 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:37.009373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:37.009992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:37.016821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:37.017311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:37.017794 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:37.019008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:37.019458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:37.019878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:37.165055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:37.173525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bcf820b4-226f-4338-9fb4-1151e1d54e30 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.168905 Oct 04 12:08:37.174156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 293/550] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:37 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:37.766855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:37.768076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:37.779488 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:37.780426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:37.781064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:37.782262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:37.783032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:37.783919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:37.948646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:37.958347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-759423b3-3b04-41b4-8fcc-97f5fad039cf tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.198968 Oct 04 12:08:37.958950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 294/551] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:37 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:38.210534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:38.211151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:38.217641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:38.218126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:38.218559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:38.219267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:38.219747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:38.220195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:38.480001 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:38.604633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:38.613211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-40758de9-c470-4bf7-af86-d1d8bdc1959e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.406585 Oct 04 12:08:38.613812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 295/552] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:38 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:38.982669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:38.983417 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:38.991307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:38.991804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:38.992291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:38.993007 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:38.993470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:38.993907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:39.145961 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:39.155339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4cb0d083-d982-48a2-9080-955490e0f16d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.176794 Oct 04 12:08:39.156006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 296/553] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:38 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:39.642311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:39.647215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:39.654294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:39.655170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:39.655964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:39.657242 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:39.657924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:39.658565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:39.857799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:39.866691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ecea0be2-6887-4cf3-a69c-e99105b98fcd tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.232834 Oct 04 12:08:39.867295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 297/554] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:39 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:40.180813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:40.181575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:40.183521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=14 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:40.189753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:40.190914 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:40.191366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:40.192091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:40.192580 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:40.193018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:40.341491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:40.350437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3966b75d-2664-44eb-9e2f-f1544e197026 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.174655 Oct 04 12:08:40.351252 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 298/555] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:40 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:40.895367 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:40.895942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:40.903120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:40.903649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:40.904102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:40.904919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:40.905402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:40.905862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:41.065569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:41.074082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b9393769-71ea-4931-aa89-0a5e73b10488 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.183625 Oct 04 12:08:41.074687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 299/556] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:40 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:41.374988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:41.375676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:41.383730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:41.384245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:41.386618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:41.386618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:41.386618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:41.386618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:41.579057 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:41.590030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5237c281-0378-40de-8ea3-c783122ec5f9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.218898 Oct 04 12:08:41.591620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 300/557] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:41 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:41.798068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-47bff1b9-f9a3-4bcd-9068-a5afdc5f2ca0 req-ecd649b5-2439-4f2f-b7da-cce4631bacb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b3f870-4de4-4585-98ce-77ea122df015", "name": "network-vif-plugged", "status": "completed", "tag": "37e28375-5f84-47c0-8196-4faed5327646"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:41.812533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-47bff1b9-f9a3-4bcd-9068-a5afdc5f2ca0 req-ecd649b5-2439-4f2f-b7da-cce4631bacb7 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:41.812533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-47bff1b9-f9a3-4bcd-9068-a5afdc5f2ca0 req-ecd649b5-2439-4f2f-b7da-cce4631bacb7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:41.812533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-47bff1b9-f9a3-4bcd-9068-a5afdc5f2ca0 req-ecd649b5-2439-4f2f-b7da-cce4631bacb7 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:41.822986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-47bff1b9-f9a3-4bcd-9068-a5afdc5f2ca0 req-ecd649b5-2439-4f2f-b7da-cce4631bacb7 service nova] Creating event network-vif-plugged:37e28375-5f84-47c0-8196-4faed5327646 for instance 22b3f870-4de4-4585-98ce-77ea122df015 on hv-cinder-86021 Oct 04 12:08:41.828573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-47bff1b9-f9a3-4bcd-9068-a5afdc5f2ca0 req-ecd649b5-2439-4f2f-b7da-cce4631bacb7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141067 Oct 04 12:08:41.829522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 301/558] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:08:42.101038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:42.101815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:42.109180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:42.109728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:42.116061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:42.116061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:42.116061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:42.116061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:42.334697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:42.344247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-295c6d99-0b94-4d38-b488-e5667679b4ff tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.248640 Oct 04 12:08:42.345019 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 302/559] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:42 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:42.634063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:42.635176 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:42.648089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:42.649059 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:42.649849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:42.651157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:42.652013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:42.652878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:42.821119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:42.830838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4ec5d49f-ac67-4fe4-b271-8f9bd1cca269 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.204909 Oct 04 12:08:42.831440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 303/560] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:42 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:43.369911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:43.370698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:43.377685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:43.378181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:43.378620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:43.379349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:43.379803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:43.380266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:43.548846 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:43.561273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-07911b98-5493-434f-b8e8-b68991656bcf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1362 microversion: 2.1 time: 0.195451 Oct 04 12:08:43.562345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 304/561] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:43 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:43.869399 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:43.870133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:43.878296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:43.878874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:43.879366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:43.880138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:43.880680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:43.881156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:44.059876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:44.069473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-dfb2f49a-7121-4382-9ea0-0fd6d484c2d9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.204095 Oct 04 12:08:44.070072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 305/562] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:43 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:44.586442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:44.587222 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:44.593728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:44.594222 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:44.594658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:44.595368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:44.595820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:44.596770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:44.613211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:08:44.758977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:44.768400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-687ab43a-7f93-4ebd-8c44-f95f44924f7f tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1548 microversion: 2.1 time: 0.185915 Oct 04 12:08:44.769022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 306/563] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:44 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:44.795070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:44.795861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:44.804117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:44.804771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:44.805291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:44.806139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:44.806744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:44.807352 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:44.922899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-35ab8c22-508d-4c05-a182-59f340d034d4 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132078 Oct 04 12:08:44.923568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 307/564] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:08:44 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:08:45.093729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:45.094497 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:45.104278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:45.105262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:45.106016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:45.107157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:45.108054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:45.108847 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:45.323437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:45.332943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3d7c35a6-810f-4647-b010-d24b845a588a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.243561 Oct 04 12:08:45.333555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 308/565] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:45 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:46.358725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:46.359519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:46.366535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:46.367068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:46.367511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:46.368339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:46.368800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:46.369224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:46.526645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:46.537655 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3c14d047-6a92-4915-b6fa-9512ae2a3d33 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.183259 Oct 04 12:08:46.538393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 309/566] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:46 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:46.720496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-ff4e2395-669b-426c-b2c8-d2078e633e6c req-340cecd9-db54-493b-9796-50a5d87df0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b3f870-4de4-4585-98ce-77ea122df015", "tag": "37e28375-5f84-47c0-8196-4faed5327646"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:08:46.729779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ff4e2395-669b-426c-b2c8-d2078e633e6c req-340cecd9-db54-493b-9796-50a5d87df0af service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:46.730353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ff4e2395-669b-426c-b2c8-d2078e633e6c req-340cecd9-db54-493b-9796-50a5d87df0af service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:46.730995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ff4e2395-669b-426c-b2c8-d2078e633e6c req-340cecd9-db54-493b-9796-50a5d87df0af service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:46.745512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-ff4e2395-669b-426c-b2c8-d2078e633e6c req-340cecd9-db54-493b-9796-50a5d87df0af service nova] Creating event network-changed:37e28375-5f84-47c0-8196-4faed5327646 for instance 22b3f870-4de4-4585-98ce-77ea122df015 on hv-cinder-86021 Oct 04 12:08:46.750855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-ff4e2395-669b-426c-b2c8-d2078e633e6c req-340cecd9-db54-493b-9796-50a5d87df0af service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036742 Oct 04 12:08:46.751944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 310/567] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:08:47.569180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:47.570227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:47.581968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:47.582848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:47.583637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:47.585062 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:47.585943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:47.586673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:47.775801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:47.788762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c1d74dbe-aad9-4631-beb1-6c969e4bd2b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.229318 Oct 04 12:08:47.790264 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 311/568] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:47 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:48.811821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:48.812543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:48.819245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:48.819727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:48.820158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:48.820874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:48.821383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:48.821802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:49.017201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:49.026907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-056e6e18-095e-4058-981f-07a7e2c643b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.218864 Oct 04 12:08:49.027600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 312/569] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:48 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:50.051391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:50.052096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:50.059130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:50.059618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:50.060051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:50.060798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:50.061243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:50.061661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:50.218614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:50.227802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4eccf612-9caf-42e0-b54a-97a6cb8b29e6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.180446 Oct 04 12:08:50.228436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 313/570] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:50 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:51.253323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:51.254295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:51.261420 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:51.261999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:51.262457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:51.263179 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:51.263716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:51.264142 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:51.425770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:51.435084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-23522cb4-f23c-496c-b12e-b6f6a2366f65 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.186574 Oct 04 12:08:51.435691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 314/571] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:51 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:52.477757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:52.478468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:52.485266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:52.485749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:52.486182 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:52.487426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:52.487941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:52.488383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:52.635924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:52.646721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-39318e7a-5ff2-4608-b8f2-3f91ffd3e358 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.172789 Oct 04 12:08:52.647529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 315/572] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:52 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:53.671335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:53.672108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:53.680204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:53.680777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:53.681299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:53.682091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:53.682629 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:53.683270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:53.838967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:53.848329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5b64306b-9e01-4442-be65-2f88f3dee849 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.180858 Oct 04 12:08:53.848940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 316/573] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:53 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:54.871480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:54.872235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:54.879634 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:54.880128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:54.880607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:54.881851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:54.881851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:54.882167 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:55.059326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:55.060860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-18436e05-830e-4d7d-ab6d-b7f20d1cccf3 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.193362 Oct 04 12:08:55.061458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 317/574] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:54 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:56.090057 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:56.090057 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:56.093551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:56.094097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:56.094605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:56.095442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:56.096540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:56.097068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:56.244825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:56.259654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7fa51d77-19d6-402c-97d5-5569b57b6785 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.177606 Oct 04 12:08:56.262193 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 318/575] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:56 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:57.289704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:57.290911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:57.303404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:57.304359 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:57.305169 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:57.306518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:57.307371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:57.308164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:57.465050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:57.475127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b6a5aa69-904a-4801-bfd0-13b1b4bcdc1f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.192989 Oct 04 12:08:57.475724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 319/576] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:57 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:08:58.192246 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:58.192751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:58.199240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:58.199729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:58.200164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:58.200897 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:58.201386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:58.201803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:58.228921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c06a0308-69c3-40da-894b-560172bf525a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/ips" status: 200 len: 148 microversion: 2.1 time: 0.041164 Oct 04 12:08:58.229526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 320/577] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:08:58 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:08:58.502457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:58.503502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:58.510695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:58.511184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:58.511613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:58.512373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:58.512825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:58.513305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:58.669887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:58.679681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5a319d98-54a0-433a-ae63-7ab05ad2f4df tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.182057 Oct 04 12:08:58.680397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 321/578] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:58 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:08:59.705483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:08:59.706350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:08:59.713505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:59.713995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:59.719069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:59.719069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:08:59.719069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:08:59.719069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:08:59.917203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:08:59.917203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c0dcce76-d4dc-4478-b75e-c93344b6cabd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.205486 Oct 04 12:08:59.917203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 322/579] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:08:59 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:00.081465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e526ff58-00b5-436b-af71-294e496600c9"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:00.085731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:00.097480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:00.103577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:00.103577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:00.103577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:00.103577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:00.103977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:00.526234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:01.308903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5abd9c19-d71e-470b-8502-298b719dfeaa tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.235136 Oct 04 12:09:01.316972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 323/580] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:09:00 2022] POST /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments => generated 194 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:01.316972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:01.318016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:01.327169 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:01.327169 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:01.327553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:01.328614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:01.329149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:01.329704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:01.490085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:01.499781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d1d698a5-7f39-4416-8fd5-649a1704c87f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1734 microversion: 2.1 time: 0.188573 Oct 04 12:09:01.500424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 324/581] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:01 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:01.902161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4ff702ae-9f12-480a-a144-7a79f165c4f6 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Calling method '.version_select at 0x7f10c36b6700>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:01.911273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=84 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:02.019581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4ff702ae-9f12-480a-a144-7a79f165c4f6 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-129740318" status: 202 len: 0 microversion: 2.1 time: 0.122078 Oct 04 12:09:02.020200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 325/582] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-129740318 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:09:02.525493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:02.526225 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:02.534103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:02.534521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:02.534945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:02.535801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:02.536372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:02.536969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:02.703038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:02.714282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fdff2e36-785f-4b35-8346-b2fafdd1bd0c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1714 microversion: 2.1 time: 0.193338 Oct 04 12:09:02.717426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 326/583] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:02 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1714 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:02.903812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:02.904484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:02.914257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:02.914830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:02.915518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:02.916678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:02.917234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:02.917872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:03.045476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] HTTP exception thrown: Cannot 'detach_volume' instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 while it is in vm_state rescued Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Request method failure captured: Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments/c6677180-dc19-448e-ab09-3197ef14120e HTTP/1.1 Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFKc-ROR5mjgB7LUfF_a4N3_Cx_fLmicq3mvRA9LKnchZ3ZfxgDtwvu51UJzf6DPqiBtokCrYUNA6TNQnkupldIz4SVhh5J73GqMUyVnKJ3QlaVNFi3s47mg9CcRdziYH06w8xQIEU4H7vZ1_s_tf8ivpsIzpDWzLmFuC1vn9kKPW8 Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:09:03.049050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f4f180049cc049829e12eace469bef05", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}] Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: f3f607e48e534dd09c3619982978e9e5 Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:09:03.051833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Cannot 'detach_volume' instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 while it is in vm_state rescued Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'server_id': '9a45ae82-9e63-4ac4-84c9-6ec1d61556a8', 'id': 'c6677180-dc19-448e-ab09-3197ef14120e'} Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:09:03.053356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 while it is in vm_state rescued Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 while it is in vm_state rescued Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:03.055754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Returning 409 to user: Cannot 'detach_volume' instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 while it is in vm_state rescued {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:09:03.057940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-69838660-1213-4940-9410-c3919b4d1908 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments/c6677180-dc19-448e-ab09-3197ef14120e" status: 409 len: 152 microversion: 2.1 time: 0.153103 Oct 04 12:09:03.057940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 327/584] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:09:02 2022] DELETE /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments/c6677180-dc19-448e-ab09-3197ef14120e => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 12:09:03.064635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:03.065211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:03.071637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:03.072228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:03.072662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:03.073842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:03.073842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:03.074275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:03.357214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-44a52312-e6c2-4003-8b4c-6a6b450053a6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "POST /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/action" status: 202 len: 0 microversion: 2.1 time: 0.295756 Oct 04 12:09:03.358434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 328/585] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:09:03 2022] POST /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:09:03.375125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:03.378203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:03.391330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:03.393093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:03.394010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:03.395463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:03.396592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:03.397539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:03.683141 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:03.695428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-83f57ec0-0cfa-46c5-b0bf-99ee7d7f6ed0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1722 microversion: 2.1 time: 0.329059 Oct 04 12:09:03.696542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 329/586] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:03 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:04.731299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:04.732300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:04.741516 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:04.742704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:04.743526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:04.744845 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:04.745696 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:04.746479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:05.021288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:05.031020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6c3f920c-0b9e-4678-bc3b-06abbd6b83cd tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1722 microversion: 2.1 time: 0.303894 Oct 04 12:09:05.031609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 330/587] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:04 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:05.971844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-528165827"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:05.972846 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:05.981311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:05.981822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:05.982434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:05.983203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:05.983848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:05.984532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:06.233612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.network.security_group_api [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Removing security group 95963f88-c138-46c0-be83-5d288a553484 from port 44eb0f3a-3cfa-4d91-958a-358c9e234313 Oct 04 12:09:06.755353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8df55a4c-8b13-4958-a822-8d4e7520e5e8 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/action" status: 202 len: 0 microversion: 2.1 time: 0.788266 Oct 04 12:09:06.759571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 331/588] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Oct 4 12:09:05 2022] POST /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/action => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:09:06.761436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:06.762268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:06.770922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:06.771725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:06.772376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:06.773355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:06.773993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:06.774591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:07.105360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:07.115541 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-61c5dec6-b5bd-42aa-bff3-cddebb9348ad tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1722 microversion: 2.1 time: 0.358354 Oct 04 12:09:07.132798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 332/589] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:06 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:07.283862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-470e03ad-d483-4831-b065-ed11378268bc req-73c6eafc-5c0a-4f9b-a864-d67c021ecdeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf295a22-6c0f-4895-9481-d51ee3d122b7", "tag": "44eb0f3a-3cfa-4d91-958a-358c9e234313"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:07.304871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-470e03ad-d483-4831-b065-ed11378268bc req-73c6eafc-5c0a-4f9b-a864-d67c021ecdeb service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:07.304871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-470e03ad-d483-4831-b065-ed11378268bc req-73c6eafc-5c0a-4f9b-a864-d67c021ecdeb service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:07.304871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-470e03ad-d483-4831-b065-ed11378268bc req-73c6eafc-5c0a-4f9b-a864-d67c021ecdeb service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:07.321716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-470e03ad-d483-4831-b065-ed11378268bc req-73c6eafc-5c0a-4f9b-a864-d67c021ecdeb service nova] Creating event network-changed:44eb0f3a-3cfa-4d91-958a-358c9e234313 for instance bf295a22-6c0f-4895-9481-d51ee3d122b7 on hv-cinder-86021 Oct 04 12:09:07.327909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-470e03ad-d483-4831-b065-ed11378268bc req-73c6eafc-5c0a-4f9b-a864-d67c021ecdeb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195569 Oct 04 12:09:07.328934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 333/590] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:08.143502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:08.145097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:08.152500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:08.153170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:08.153673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:08.154880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:08.155034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:08.155571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:08.688564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:08.709571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-03f05fcb-0847-41d7-9ee9-b748c85713d1 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1728 microversion: 2.1 time: 0.571473 Oct 04 12:09:08.717250 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 334/591] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:08 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1728 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:08.759474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:08.759474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:08.778531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:08.780773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:08.792787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:08.793995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:08.800529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:08.801423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:08.981624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-44d75cf7-c6ea-469a-a870-81c69d980cde tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233445 Oct 04 12:09:08.982565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 335/592] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:09:08 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:08.992250 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:08.993190 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:09.004251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:09.005368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:09.006197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:09.007454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:09.008435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:09.009381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:09.174933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lazy-loading 'services' on Instance uuid bf295a22-6c0f-4895-9481-d51ee3d122b7 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:09:09.555294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-34e80ab0-17c9-4639-a5c4-b63164ed28c9 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments/72010dd5-086e-4db0-b38f-1eb179d56b60" status: 202 len: 0 microversion: 2.1 time: 0.569396 Oct 04 12:09:09.560465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 336/593] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:09:08 2022] DELETE /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments/72010dd5-086e-4db0-b38f-1eb179d56b60 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:09:09.582082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-13b32b47-2b8c-47ca-9914-7fcf627f88ba req-01472ae1-cc84-479d-8521-8904c2262406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf295a22-6c0f-4895-9481-d51ee3d122b7", "tag": "44eb0f3a-3cfa-4d91-958a-358c9e234313"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:09.603138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-13b32b47-2b8c-47ca-9914-7fcf627f88ba req-01472ae1-cc84-479d-8521-8904c2262406 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:09.604072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-13b32b47-2b8c-47ca-9914-7fcf627f88ba req-01472ae1-cc84-479d-8521-8904c2262406 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:09.604895 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-13b32b47-2b8c-47ca-9914-7fcf627f88ba req-01472ae1-cc84-479d-8521-8904c2262406 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:09.631307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-13b32b47-2b8c-47ca-9914-7fcf627f88ba req-01472ae1-cc84-479d-8521-8904c2262406 service nova] Creating event network-changed:44eb0f3a-3cfa-4d91-958a-358c9e234313 for instance bf295a22-6c0f-4895-9481-d51ee3d122b7 on hv-cinder-86021 Oct 04 12:09:09.641254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-13b32b47-2b8c-47ca-9914-7fcf627f88ba req-01472ae1-cc84-479d-8521-8904c2262406 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074511 Oct 04 12:09:09.643530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 337/594] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:09.658024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:09.664935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:09.679775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:09.681371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:09.692550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:09.692550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:09.693882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:09.695175 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:09.808344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f8f2b1c7-e0b9-4cce-944c-5806a66fbb19 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159172 Oct 04 12:09:09.810026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 338/595] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:09:09 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:10.449189 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e526ff58-00b5-436b-af71-294e496600c9"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:10.455191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:10.473074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:10.476820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:10.480476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:10.480476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:10.480476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:10.481997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:10.677979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Invalid volume: volume e526ff58-00b5-436b-af71-294e496600c9 is already attached to instances: f0314f45-1648-422f-9456-e64956b6ad32 Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: POST /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments HTTP/1.1 Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 74 Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:09:10.682028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {"volumeAttachment": {"volumeId": "e526ff58-00b5-436b-af71-294e496600c9"}} Oct 04 12:09:10.685290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Invalid volume: volume e526ff58-00b5-436b-af71-294e496600c9 is already attached to instances: f0314f45-1648-422f-9456-e64956b6ad32 Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'server_id': 'f0314f45-1648-422f-9456-e64956b6ad32', 'body': {'volumeAttachment': {'volumeId': 'e526ff58-00b5-436b-af71-294e496600c9'}}} Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e526ff58-00b5-436b-af71-294e496600c9 is already attached to instances: f0314f45-1648-422f-9456-e64956b6ad32 Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:10.687085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e526ff58-00b5-436b-af71-294e496600c9 is already attached to instances: f0314f45-1648-422f-9456-e64956b6ad32 Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:10.694401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e526ff58-00b5-436b-af71-294e496600c9 is already attached to instances: f0314f45-1648-422f-9456-e64956b6ad32 Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 400 to user: Invalid volume: volume e526ff58-00b5-436b-af71-294e496600c9 is already attached to instances: f0314f45-1648-422f-9456-e64956b6ad32 {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-709e5ba0-8c59-4409-a8fb-a8b9a891ddae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.247021 Oct 04 12:09:10.697714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 339/596] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:09:10 2022] POST /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments => generated 174 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 12:09:10.844830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:10.851885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:10.867240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:10.869802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:10.869802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:10.870843 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:10.871518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:10.872157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:10.912761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bf2e6650-92ee-4c84-a6c7-bfdb5c6f74e4 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087558 Oct 04 12:09:10.919115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 340/597] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:09:10 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:10.925593 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:10.927374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:10.934271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:10.935152 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:10.935816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:10.936900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:10.937731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:10.944248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:10.965251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:11.050770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'services' on Instance uuid f0314f45-1648-422f-9456-e64956b6ad32 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:09:11.446112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-31e9e0b0-5552-4b04-9e01-8a6946e3eb5e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments/e526ff58-00b5-436b-af71-294e496600c9" status: 202 len: 0 microversion: 2.1 time: 0.524295 Oct 04 12:09:11.448724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 341/598] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:09:10 2022] DELETE /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments/e526ff58-00b5-436b-af71-294e496600c9 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:09:11.474547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:11.481092 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:11.499324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:11.501912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:11.504802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:11.507314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:11.509260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:11.510843 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:11.584640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9991ad35-773b-49df-8bb8-d9fb2f54f490 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127926 Oct 04 12:09:11.586244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 342/599] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:09:11 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:11.836236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-6d959bdd-baa0-42a5-b8f7-4c892ae594e9 req-42aaab6c-0969-4105-995d-444619b27e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a45ae82-9e63-4ac4-84c9-6ec1d61556a8", "tag": "b026d660-150c-4793-803c-fc2cbcfe5527"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:11.855910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6d959bdd-baa0-42a5-b8f7-4c892ae594e9 req-42aaab6c-0969-4105-995d-444619b27e8b service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:11.858414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6d959bdd-baa0-42a5-b8f7-4c892ae594e9 req-42aaab6c-0969-4105-995d-444619b27e8b service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:11.859909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6d959bdd-baa0-42a5-b8f7-4c892ae594e9 req-42aaab6c-0969-4105-995d-444619b27e8b service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:11.874459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-6d959bdd-baa0-42a5-b8f7-4c892ae594e9 req-42aaab6c-0969-4105-995d-444619b27e8b service nova] Creating event network-changed:b026d660-150c-4793-803c-fc2cbcfe5527 for instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 on hv-cinder-86021 Oct 04 12:09:11.882637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-6d959bdd-baa0-42a5-b8f7-4c892ae594e9 req-42aaab6c-0969-4105-995d-444619b27e8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050445 Oct 04 12:09:11.883948 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 343/600] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:11.931773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:11.937425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:11.949274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:11.950047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:11.950891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:11.952206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:11.953017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:11.953796 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:12.013568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c9e78bfc-0d93-47a8-bba8-b73ddab11dd0 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090571 Oct 04 12:09:12.021203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 344/601] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:09:11 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 12:09:12.031840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:12.033679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:12.045840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:12.046863 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:12.047785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:12.049773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:12.051032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:12.051663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:12.162969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] HTTP exception thrown: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 is not attached to volume 72010dd5-086e-4db0-b38f-1eb179d56b60 Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Request method failure captured: Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments/72010dd5-086e-4db0-b38f-1eb179d56b60 HTTP/1.1 Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFuzSabE0aLLTEUNvl4EQdlfMSQlrHgDOyrIRlpcRD-5Rlic93CzJlG80jNyU_GY7myX1WQWLR-C4S3fwmQ9mSb8zLPF0x0AbCUHL_7g_RWMYgDRZboHbJkS6C1XUVKQPFoXi0sAUEeNLJd8CWU55HILefm_y4tVhxOlvFnpAgYawE Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 950b28fc6faf434482bbb1c2db3fa194 Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-TestMinimumBasicScenario-372971956 Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:09:12.165623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_950b28fc6faf434482bbb1c2db3fa194", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/950b28fc6faf434482bbb1c2db3fa194"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/950b28fc6faf434482bbb1c2db3fa194"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/950b28fc6faf434482bbb1c2db3fa194"}]}] Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-TestMinimumBasicScenario-372971956 Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 950b28fc6faf434482bbb1c2db3fa194 Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-TestMinimumBasicScenario-372971956 Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-TestMinimumBasicScenario-372971956-project Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2b8dc16b63584a46b9f63b52aa5ce391 Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-TestMinimumBasicScenario-372971956-project Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:09:12.168570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 is not attached to volume 72010dd5-086e-4db0-b38f-1eb179d56b60 Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'server_id': 'bf295a22-6c0f-4895-9481-d51ee3d122b7', 'id': '72010dd5-086e-4db0-b38f-1eb179d56b60'} Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 72010dd5-086e-4db0-b38f-1eb179d56b60. Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:09:12.170070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 is not attached to volume 72010dd5-086e-4db0-b38f-1eb179d56b60 Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 is not attached to volume 72010dd5-086e-4db0-b38f-1eb179d56b60 Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:12.173205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Returning 404 to user: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 is not attached to volume 72010dd5-086e-4db0-b38f-1eb179d56b60 {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:09:12.175379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8b6907f8-5a9b-495b-9e4a-3b2abd3b7a54 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments/72010dd5-086e-4db0-b38f-1eb179d56b60" status: 404 len: 154 microversion: 2.1 time: 0.143867 Oct 04 12:09:12.175379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 345/602] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:09:12 2022] DELETE /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7/os-volume_attachments/72010dd5-086e-4db0-b38f-1eb179d56b60 => generated 154 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:09:12.623916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:12.630041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:12.639197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:12.644748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:12.644748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:12.644748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:12.644748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:12.645210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:12.680267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-61427003-8b4a-42cb-b8ec-8ad8e50b99ff tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086271 Oct 04 12:09:12.680868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 346/603] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:09:12 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:13.663854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:13.664772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:13.672549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:13.673102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:13.673547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:13.674276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:13.674736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:13.675194 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:13.706387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:09:14.084435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0ebab5bf-bbfd-463e-9320-7c23e8fd8518 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 204 len: 0 microversion: 2.1 time: 0.424432 Oct 04 12:09:14.084949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 347/604] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:09:13 2022] DELETE /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:09:14.090686 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:14.092947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:14.099502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.099988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.100466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.101183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.101644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.102041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.137400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c2ce6317-7916-467a-8202-8772a0bca1da tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051138 Oct 04 12:09:14.137990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 348/605] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:09:14 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:09:14.149610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-6325d3b1-a281-48b6-a944-01b356152cc6 req-9e527720-150b-413e-b3ed-2347a982b319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a45ae82-9e63-4ac4-84c9-6ec1d61556a8", "tag": "b026d660-150c-4793-803c-fc2cbcfe5527"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:14.160847 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6325d3b1-a281-48b6-a944-01b356152cc6 req-9e527720-150b-413e-b3ed-2347a982b319 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.161155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6325d3b1-a281-48b6-a944-01b356152cc6 req-9e527720-150b-413e-b3ed-2347a982b319 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.161643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6325d3b1-a281-48b6-a944-01b356152cc6 req-9e527720-150b-413e-b3ed-2347a982b319 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.174997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-6325d3b1-a281-48b6-a944-01b356152cc6 req-9e527720-150b-413e-b3ed-2347a982b319 service nova] Creating event network-changed:b026d660-150c-4793-803c-fc2cbcfe5527 for instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 on hv-cinder-86021 Oct 04 12:09:14.181883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-6325d3b1-a281-48b6-a944-01b356152cc6 req-9e527720-150b-413e-b3ed-2347a982b319 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042440 Oct 04 12:09:14.182503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 349/606] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:14.193585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:14.195453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:14.205657 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.206501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.207201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.209154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.209802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.210235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.401434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:14.410322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8602a557-99e8-40df-ba58-6cf76c5db460 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1555 microversion: 2.1 time: 0.223350 Oct 04 12:09:14.410924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 350/607] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:14 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:14.415893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:14.416432 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:14.423717 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.424237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.424683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.425402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.425860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.426287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.455779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:09:14.838579 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0747a1bd-e480-411f-aabf-6bacdead239f tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 204 len: 0 microversion: 2.1 time: 0.426314 Oct 04 12:09:14.839645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 351/608] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:09:14 2022] DELETE /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:09:14.849462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:14.850119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:14.857259 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.857779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.858291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:14.859006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:14.859469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:14.859887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:15.080160 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:15.089231 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-02bafdd0-15a7-42f3-b7d9-3feff5dee56d tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1678 microversion: 2.1 time: 0.244945 Oct 04 12:09:15.089953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 352/609] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:14 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:15.435131 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:15.435746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:15.443100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:15.444014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:15.444474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:15.445186 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:15.445633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:15.446072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:15.624706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:15.633851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2620e8b3-4978-4892-8099-db7deeed64be tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1555 microversion: 2.1 time: 0.202598 Oct 04 12:09:15.634575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 353/610] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:15 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:16.114669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:16.115455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:16.122471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:16.122957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:16.123389 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:16.124210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:16.124689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:16.125103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:16.347355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:16.362956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-71221144-2eb1-4399-afcd-b0c6ef4904ed tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1678 microversion: 2.1 time: 0.252598 Oct 04 12:09:16.364099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 354/611] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:16 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:16.659079 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:16.659705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:16.666314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:16.672551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:16.672551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:16.672551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:16.672551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:16.673285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:16.673285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:16.816659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:16.825899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1049c5cd-055a-4b1d-b9ec-4821fbc0438f tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1555 microversion: 2.1 time: 0.171438 Oct 04 12:09:16.826585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 355/612] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:16 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:17.387865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:17.388674 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:17.396335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:17.396811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:17.397238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:17.397934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:17.398429 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:17.398840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:17.570279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:17.578462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4039d895-4f9e-42ce-85a3-ce686aa91e81 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1678 microversion: 2.1 time: 0.194827 Oct 04 12:09:17.579587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 356/613] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:17 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:17.849677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:17.850296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:17.856726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:17.857222 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:17.857661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:17.858376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:17.858865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:17.859293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:18.000154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:18.009918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5be08c5f-5eda-4da3-b638-3166f1f0c4db tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1555 microversion: 2.1 time: 0.164149 Oct 04 12:09:18.010737 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 357/614] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:17 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:18.603987 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:18.604874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:18.612759 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:18.613283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:18.613702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:18.614433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:18.614893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:18.615321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:18.770355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:18.784970 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d1a9818e-4f90-4817-a7a5-8593b619a981 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1678 microversion: 2.1 time: 0.185188 Oct 04 12:09:18.786026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 358/615] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:18 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:19.034696 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:19.035205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:19.041854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:19.042344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:19.042840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:19.043554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:19.044018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:19.044470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:19.446673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:19.455534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2a9aa999-962b-4d8e-9896-6099f841e544 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1555 microversion: 2.1 time: 0.425567 Oct 04 12:09:19.456132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 359/616] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:19 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1555 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:19.811865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:19.812989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:19.821826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:19.822496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:19.823041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:19.823888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:19.824511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:19.825042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:20.039821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:20.057091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e21aa79e-09e0-44ce-a6a9-5158fcd108d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1678 microversion: 2.1 time: 0.249701 Oct 04 12:09:20.058764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 360/617] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:19 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:20.503003 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:20.504671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:20.520077 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:20.521008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:20.522124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:20.523613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:20.524292 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:20.525108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:20.663842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:20.673248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5887bf92-015d-4262-a052-c1bd07a1011c tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1513 microversion: 2.1 time: 0.182688 Oct 04 12:09:20.673903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 361/618] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:20 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:20.678860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-6d03e3b5-c686-4e7d-9c97-5cc2606fae94 req-7b348670-ad2f-4bc2-9d79-ed05efe74cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf295a22-6c0f-4895-9481-d51ee3d122b7", "name": "network-vif-deleted", "tag": "44eb0f3a-3cfa-4d91-958a-358c9e234313"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:20.689345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6d03e3b5-c686-4e7d-9c97-5cc2606fae94 req-7b348670-ad2f-4bc2-9d79-ed05efe74cce service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:20.689850 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6d03e3b5-c686-4e7d-9c97-5cc2606fae94 req-7b348670-ad2f-4bc2-9d79-ed05efe74cce service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:20.690284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6d03e3b5-c686-4e7d-9c97-5cc2606fae94 req-7b348670-ad2f-4bc2-9d79-ed05efe74cce service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:20.704367 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-6d03e3b5-c686-4e7d-9c97-5cc2606fae94 req-7b348670-ad2f-4bc2-9d79-ed05efe74cce service nova] Creating event network-vif-deleted:44eb0f3a-3cfa-4d91-958a-358c9e234313 for instance bf295a22-6c0f-4895-9481-d51ee3d122b7 on hv-cinder-86021 Oct 04 12:09:20.711530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-6d03e3b5-c686-4e7d-9c97-5cc2606fae94 req-7b348670-ad2f-4bc2-9d79-ed05efe74cce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035575 Oct 04 12:09:20.712931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 362/619] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:21.094351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:21.095915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:21.103166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:21.103645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:21.104318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:21.105049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:21.105505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:21.105928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:21.193441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:21.204544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0808106f-b105-4b07-838f-e0ba6fe961dc tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1610 microversion: 2.1 time: 0.114959 Oct 04 12:09:21.205329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 363/620] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:21 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1610 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:21.409032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-7ed31c31-2aec-40fe-a3b9-d14fb8674f67 req-bb50c523-e851-41fa-b3a6-f0a89e5d5907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0314f45-1648-422f-9456-e64956b6ad32", "name": "network-vif-deleted", "tag": "386857ff-677e-4c78-8e4f-9bfd1ad1be0b"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:21.422343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7ed31c31-2aec-40fe-a3b9-d14fb8674f67 req-bb50c523-e851-41fa-b3a6-f0a89e5d5907 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:21.423864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7ed31c31-2aec-40fe-a3b9-d14fb8674f67 req-bb50c523-e851-41fa-b3a6-f0a89e5d5907 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:21.428962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7ed31c31-2aec-40fe-a3b9-d14fb8674f67 req-bb50c523-e851-41fa-b3a6-f0a89e5d5907 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:21.439409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-7ed31c31-2aec-40fe-a3b9-d14fb8674f67 req-bb50c523-e851-41fa-b3a6-f0a89e5d5907 service nova] Creating event network-vif-deleted:386857ff-677e-4c78-8e4f-9bfd1ad1be0b for instance f0314f45-1648-422f-9456-e64956b6ad32 on hv-cinder-86021 Oct 04 12:09:21.445527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-7ed31c31-2aec-40fe-a3b9-d14fb8674f67 req-bb50c523-e851-41fa-b3a6-f0a89e5d5907 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 Oct 04 12:09:21.449932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 364/621] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:21.713699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:21.714499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:21.722682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:21.726730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:21.726730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:21.726730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:21.726730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:21.727081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:21.762784 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:21.763624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:21.764332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:21.765007 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lazy-loading 'fault' on Instance uuid bf295a22-6c0f-4895-9481-d51ee3d122b7 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:09:21.818345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b8dc16b63584a46b9f63b52aa5ce391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b28fc6faf434482bbb1c2db3fa194', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:21.826457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-80bea94a-b041-4f69-9015-99bfd1a39a7a tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 200 len: 1348 microversion: 2.1 time: 0.118639 Oct 04 12:09:21.827060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 365/622] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:21 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 1348 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:22.241719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:22.242507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:22.249641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:22.250131 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:22.251089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:22.252067 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:22.252550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:22.252973 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:22.292683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:22.297349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:22.297878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:22.298310 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:22.298765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'fault' on Instance uuid f0314f45-1648-422f-9456-e64956b6ad32 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:09:22.353107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:22.367591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-58773094-c71f-4a8b-af65-93cc52df7ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 200 len: 1329 microversion: 2.1 time: 0.129704 Oct 04 12:09:22.368622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 366/623] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:22 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:22.852154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:22.852903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] [instance: bf295a22-6c0f-4895-9481-d51ee3d122b7] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:22.862362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:22.863095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:22.863739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:22.864777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:22.865477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:22.866032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:22.884841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] HTTP exception thrown: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 could not be found. Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Request method failure captured: Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 HTTP/1.1 Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFuzSabE0aLLTEUNvl4EQdlfMSQlrHgDOyrIRlpcRD-5Rlic93CzJlG80jNyU_GY7myX1WQWLR-C4S3fwmQ9mSb8zLPF0x0AbCUHL_7g_RWMYgDRZboHbJkS6C1XUVKQPFoXi0sAUEeNLJd8CWU55HILefm_y4tVhxOlvFnpAgYawE Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 950b28fc6faf434482bbb1c2db3fa194 Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-TestMinimumBasicScenario-372971956 Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:09:22.887440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_950b28fc6faf434482bbb1c2db3fa194", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/950b28fc6faf434482bbb1c2db3fa194"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/950b28fc6faf434482bbb1c2db3fa194"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/950b28fc6faf434482bbb1c2db3fa194"}]}] Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-TestMinimumBasicScenario-372971956 Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 950b28fc6faf434482bbb1c2db3fa194 Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-TestMinimumBasicScenario-372971956 Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-TestMinimumBasicScenario-372971956-project Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2b8dc16b63584a46b9f63b52aa5ce391 Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-TestMinimumBasicScenario-372971956-project Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 could not be found. Oct 04 12:09:22.890694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'bf295a22-6c0f-4895-9481-d51ee3d122b7'} Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 could not be found. Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:09:22.891738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 could not be found. Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 could not be found. Oct 04 12:09:22.893261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:22.894525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Returning 404 to user: Instance bf295a22-6c0f-4895-9481-d51ee3d122b7 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:09:22.894525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d0119148-5f40-46ae-9505-37ee07a71170 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7" status: 404 len: 111 microversion: 2.1 time: 0.042047 Oct 04 12:09:22.894525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 367/624] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:22 2022] GET /compute/v2.1/servers/bf295a22-6c0f-4895-9481-d51ee3d122b7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:09:22.901463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-480ed24e-4596-49e6-80db-e17ceee1e137 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] Calling method '.version_select at 0x7f10c3621e50>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:23.029849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-480ed24e-4596-49e6-80db-e17ceee1e137 tempest-TestMinimumBasicScenario-372971956 tempest-TestMinimumBasicScenario-372971956-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-808896546" status: 202 len: 0 microversion: 2.1 time: 0.131215 Oct 04 12:09:23.030493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 368/625] 10.222.0.15 () {58 vars in 1269 bytes} [Tue Oct 4 12:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-808896546 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:09:23.394678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:23.395575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:23.402788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:23.403283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:23.403719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:23.404469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:23.404928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:23.405349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:23.420609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 HTTP/1.1 Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:09:23.422295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:09:23.424711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'f0314f45-1648-422f-9456-e64956b6ad32'} Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:09:23.425862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:09:23.428018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:23.433561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:09:23.433561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3732805e-90a8-47ca-aca8-7cd75aaa69c8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 404 len: 111 microversion: 2.1 time: 0.034130 Oct 04 12:09:23.433561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 369/626] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:23 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:09:23.434062 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bd82b5f7-7536-43aa-b066-d00a5cc96997 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '.version_select at 0x7f10c3aa7700>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:23.583696 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bd82b5f7-7536-43aa-b066-d00a5cc96997 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-94192657" status: 202 len: 0 microversion: 2.1 time: 0.153454 Oct 04 12:09:23.584710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 370/627] 10.222.0.15 () {58 vars in 1215 bytes} [Tue Oct 4 12:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-94192657 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:09:24.631387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8979f44e-6a82-49f1-8794-25697b196b45 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: .version_select at 0x7f10c38374c0>, body: {"keypair": {"name": "tempest-keypair-1848461543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoxLpqT2UI6L5JOzm5XuYSZwXFaLEiGkfGukye+/Dubqj374Ks5cp3bPA6BgITXyLyaF4yDjKRqQEaX721+g6Ei5uignbp47YJPr/xa3tt0gbfFaT7i/qbQMyh7Za0N+Q=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:24.650597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-8979f44e-6a82-49f1-8794-25697b196b45 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:09:24.655481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-8979f44e-6a82-49f1-8794-25697b196b45 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:09:24.797178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8979f44e-6a82-49f1-8794-25697b196b45 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170718 Oct 04 12:09:24.797972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 371/628] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Oct 4 12:09:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:28.551388 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1732439929", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a843603-1123-4e00-9b28-113fe25ca6eb"}], "security_groups": [{"name": "tempest-securitygroup--1920503861"}], "key_name": "tempest-keypair-1848461543", "user_data": "}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:28.738368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] validate_networks() for [('6a843603-1123-4e00-9b28-113fe25ca6eb', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:09:29.437023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:09:29.437023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:09:29.437023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:09:29.437023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:09:29.437023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:09:29.449925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:29.450414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:29.450854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:29.451595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:29.452044 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:29.452503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:29.477616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:09:29.477616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Getting quotas for user 0e8d03fe51534f8e867d0f83c3db2d36 and project f021c9955236461abc441e2a31421b8b. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:09:29.491656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:09:29.494284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:09:29.667448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6f62e6a5-c3ee-4fb0-8931-0b403a8c44d0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.124629 Oct 04 12:09:29.668803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 372/629] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:09:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:09:29.693607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-697e150f-72e5-4395-a575-5137fa413c8c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:29.694749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-697e150f-72e5-4395-a575-5137fa413c8c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:29.826016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-697e150f-72e5-4395-a575-5137fa413c8c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:29.833344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-697e150f-72e5-4395-a575-5137fa413c8c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1242 microversion: 2.1 time: 0.147789 Oct 04 12:09:29.849047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 373/630] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:29 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:30.859364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e0e8c841-bbd1-46e9-aae3-45e559606600 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:30.860730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e0e8c841-bbd1-46e9-aae3-45e559606600 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:30.924228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e0e8c841-bbd1-46e9-aae3-45e559606600 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:30.932230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e0e8c841-bbd1-46e9-aae3-45e559606600 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1242 microversion: 2.1 time: 0.077908 Oct 04 12:09:30.932960 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 374/631] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:30 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:31.957009 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:31.957708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:31.965592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:31.966206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:31.966648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:31.967359 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:31.967875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:31.968427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:32.062153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:32.070774 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-98ba4a87-c2dc-4a95-a18b-c1cef330a1d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1238 microversion: 2.1 time: 0.118167 Oct 04 12:09:32.075452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 375/632] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:31 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1238 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:33.099230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:33.101922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:33.130992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:33.131894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:33.132372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:33.133371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:33.134036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:33.134626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:33.233055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:33.243789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-26820554-78cf-4864-836c-bc195afdbd69 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1294 microversion: 2.1 time: 0.152423 Oct 04 12:09:33.245075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 376/633] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:33 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:34.295355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:34.298231 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:34.309237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:34.309647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:34.310223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:34.311767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:34.313470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:34.314196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:34.432208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:34.446856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5262e8d6-b509-44fd-b3f6-98830635fec7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1300 microversion: 2.1 time: 0.160436 Oct 04 12:09:34.448034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 377/634] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:34 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:35.472704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:35.473821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:35.481931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:35.487805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:35.487805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:35.487805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:35.487805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:35.488785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:35.816436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:35.826319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5443978d-2a22-4e52-9969-a202c5d6d8f9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.357689 Oct 04 12:09:35.839156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 378/635] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:35 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:36.543518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-78bf2e7d-b9fc-4fdb-92c6-b34fbc75a638 req-1f340e1d-4677-4e84-b03c-d0308e301aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e61328a-974d-4929-a32b-c273cfccc860", "tag": "86a606d0-4e07-41bc-9330-5f9413303abc"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:36.556820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-78bf2e7d-b9fc-4fdb-92c6-b34fbc75a638 req-1f340e1d-4677-4e84-b03c-d0308e301aee service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:36.557385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-78bf2e7d-b9fc-4fdb-92c6-b34fbc75a638 req-1f340e1d-4677-4e84-b03c-d0308e301aee service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:36.557882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-78bf2e7d-b9fc-4fdb-92c6-b34fbc75a638 req-1f340e1d-4677-4e84-b03c-d0308e301aee service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:36.571661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-78bf2e7d-b9fc-4fdb-92c6-b34fbc75a638 req-1f340e1d-4677-4e84-b03c-d0308e301aee service nova] Creating event network-changed:86a606d0-4e07-41bc-9330-5f9413303abc for instance 3e61328a-974d-4929-a32b-c273cfccc860 on hv-cinder-86021 Oct 04 12:09:36.577134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-78bf2e7d-b9fc-4fdb-92c6-b34fbc75a638 req-1f340e1d-4677-4e84-b03c-d0308e301aee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040827 Oct 04 12:09:36.577749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 379/636] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:36.862874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:36.864589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:36.884878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:36.885740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:36.886483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:36.887773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:36.888690 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:36.889459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:36.898787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:37.095877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:37.104233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-85d47e41-f1f4-46ab-a5ce-2c126bd514db tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.249811 Oct 04 12:09:37.104835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 380/637] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:36 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:38.129527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:38.130420 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:38.138791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:38.139700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:38.141237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:38.142505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:38.143333 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:38.144193 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:38.360489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:38.369008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c8b96287-613f-471e-9c78-f1a5c808f774 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.244862 Oct 04 12:09:38.369608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 381/638] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:38 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:39.393010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:39.393770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:39.400653 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:39.401133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:39.401566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:39.402271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:39.402715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:39.403129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:39.460484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:39.551428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:39.558258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-234ae860-8e60-47c0-912b-f3153416b0b6 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.169057 Oct 04 12:09:39.558890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 382/639] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:39 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:40.581158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:40.581898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:40.588979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:40.589474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:40.589912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:40.590626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:40.591147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:40.591613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:40.751134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:40.760608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4b830b2e-bf41-4829-a276-4a76744177f8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.183838 Oct 04 12:09:40.761186 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 383/640] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:40 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:41.003733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:41.004262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:41.006194 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=14 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:41.011353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:41.011884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:41.013837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:41.014456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:41.018376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:41.018376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:41.048081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:09:41.579743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-340b88d8-e2af-461d-9cd1-96ee0044786b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 204 len: 0 microversion: 2.1 time: 0.579422 Oct 04 12:09:41.580899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 384/641] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:09:40 2022] DELETE /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:09:41.590115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:41.591308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:41.598640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:41.599133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:41.599616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:41.600380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:41.600838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:41.601265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:41.771315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:41.786898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6415e1e0-a775-4f5b-b0fc-7937bd4629e7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1576 microversion: 2.1 time: 0.200777 Oct 04 12:09:41.791626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 385/642] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:41 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:41.796660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:41.798940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:41.813569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:41.814387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:41.815824 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:41.816846 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:41.817319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:41.817749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:41.972290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:41.987729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2013e7e6-b2c7-463e-bfca-a749c36b0d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.197759 Oct 04 12:09:41.988836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 386/643] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:41 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:42.091552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-92a5ac32-3c26-4ad1-9fd7-b688bd7d18a2 req-8bd208fc-9b5f-405d-b92e-cb58ef30f7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e61328a-974d-4929-a32b-c273cfccc860", "name": "network-vif-plugged", "status": "completed", "tag": "86a606d0-4e07-41bc-9330-5f9413303abc"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:42.102180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-92a5ac32-3c26-4ad1-9fd7-b688bd7d18a2 req-8bd208fc-9b5f-405d-b92e-cb58ef30f7ea service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:42.102652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-92a5ac32-3c26-4ad1-9fd7-b688bd7d18a2 req-8bd208fc-9b5f-405d-b92e-cb58ef30f7ea service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:42.103075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-92a5ac32-3c26-4ad1-9fd7-b688bd7d18a2 req-8bd208fc-9b5f-405d-b92e-cb58ef30f7ea service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:42.115099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-92a5ac32-3c26-4ad1-9fd7-b688bd7d18a2 req-8bd208fc-9b5f-405d-b92e-cb58ef30f7ea service nova] Creating event network-vif-plugged:86a606d0-4e07-41bc-9330-5f9413303abc for instance 3e61328a-974d-4929-a32b-c273cfccc860 on hv-cinder-86021 Oct 04 12:09:42.120563 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-92a5ac32-3c26-4ad1-9fd7-b688bd7d18a2 req-8bd208fc-9b5f-405d-b92e-cb58ef30f7ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032690 Oct 04 12:09:42.121168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 387/644] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:42.615750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:42.616450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:42.623070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:42.623558 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:42.623993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:42.625233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:42.625684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:42.626110 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:42.652339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-211f9c88-d95e-44b9-846c-78b9e50647b3 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/ips" status: 200 len: 145 microversion: 2.1 time: 0.041193 Oct 04 12:09:42.652938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 388/645] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:09:42 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:42.822462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:42.823403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:42.830289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:42.831132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:42.831718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:42.832688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:42.833209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:42.833792 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:42.976891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:42.992581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c879eebd-1219-4d4b-9822-4d699714b842 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1576 microversion: 2.1 time: 0.174549 Oct 04 12:09:42.993177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 389/646] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:42 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:43.021691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:43.022319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:43.028835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:43.029320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:43.029765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:43.030474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:43.030991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:43.031448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:43.187097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:43.195400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-01e0153b-12f5-45ae-9812-b93e307bed3a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.177859 Oct 04 12:09:43.195999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 390/647] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:43 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:44.020000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:44.021086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:44.030002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:44.030504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:44.030985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:44.031704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:44.032152 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:44.032601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:44.222707 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:44.235505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-86fb9ead-1939-4e65-bf9e-cbc31161fd9c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1576 microversion: 2.1 time: 0.220691 Oct 04 12:09:44.236643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 391/648] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:44 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:44.248112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:44.249301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:44.261553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:44.262458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:44.263260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:44.265010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:44.266567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:44.267165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:44.450310 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:44.462677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8c9e1ad9-678b-4aa2-be9d-05371b140964 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1368 microversion: 2.1 time: 0.220782 Oct 04 12:09:44.473033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 392/649] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:44 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:44.481980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b6279d2-574f-4105-bab1-69ab9401fb62"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:44.484602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:44.490726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:44.491216 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:44.491652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:44.492468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:44.492980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:44.493412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.247490 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-694dbdfa-1bfc-4ad8-8656-53d2a7ff8ce1 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.769329 Oct 04 12:09:46.254805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 393/650] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:09:44 2022] POST /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments => generated 194 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:46.266777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-686661c4-56b5-4594-8ad9-0f103579bda0 req-25f66047-561b-4e25-89f0-905f99e129ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5b93b6-ec32-4534-b51b-15e8eeb734d1", "name": "network-vif-deleted", "tag": "3a1010f5-4eac-4dd5-9fa0-faf7a2c11531"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:46.278016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-686661c4-56b5-4594-8ad9-0f103579bda0 req-25f66047-561b-4e25-89f0-905f99e129ff service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:46.278501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-686661c4-56b5-4594-8ad9-0f103579bda0 req-25f66047-561b-4e25-89f0-905f99e129ff service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:46.278934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-686661c4-56b5-4594-8ad9-0f103579bda0 req-25f66047-561b-4e25-89f0-905f99e129ff service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.292639 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-686661c4-56b5-4594-8ad9-0f103579bda0 req-25f66047-561b-4e25-89f0-905f99e129ff service nova] Creating event network-vif-deleted:3a1010f5-4eac-4dd5-9fa0-faf7a2c11531 for instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 on hv-cinder-86021 Oct 04 12:09:46.299810 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-686661c4-56b5-4594-8ad9-0f103579bda0 req-25f66047-561b-4e25-89f0-905f99e129ff service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043190 Oct 04 12:09:46.300813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 394/651] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:46.307162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:46.307876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:46.315459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:46.315964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:46.316431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.317148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:46.317605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:46.318030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.346882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:46.398923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:46.408945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-365410ad-ed0e-425e-b9dd-8e8ad5ef21e2 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1223 microversion: 2.1 time: 0.106751 Oct 04 12:09:46.412036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 395/652] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:46 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:46.414517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:46.415342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:46.417266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:46.422768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:46.423589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:46.424266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.425144 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:46.425610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:46.426041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.576493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:46.592891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3a6d7ed7-3a8b-4ae2-a7c8-3a2941f63eba tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1557 microversion: 2.1 time: 0.181947 Oct 04 12:09:46.604435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 396/653] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:46 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1557 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:46.632622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:46.633161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:46.640554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:46.641234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:46.641669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.642449 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:46.643261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:46.643980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:46.773743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-471a697a-c4b6-4d28-a343-a61dfb68ffa3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144351 Oct 04 12:09:46.773743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 397/654] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Oct 4 12:09:46 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:47.433203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:47.433865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:47.441492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:47.447689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:47.447689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:47.447689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:47.447689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:47.448404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:47.480904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:47.481392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:47.481824 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:47.482277 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lazy-loading 'fault' on Instance uuid fe5b93b6-ec32-4534-b51b-15e8eeb734d1 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:09:47.553781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:47.564584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b18b0c72-8298-4541-815e-5bda8dbdf43d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 200 len: 1228 microversion: 2.1 time: 0.135855 Oct 04 12:09:47.569480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 398/655] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:47 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 1228 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:48.317916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-ca39ce7d-3654-47ba-bac9-da833a907e8d req-650bf0bc-9c70-417d-b75f-3928f58334d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e61328a-974d-4929-a32b-c273cfccc860", "tag": "86a606d0-4e07-41bc-9330-5f9413303abc"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:48.329802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ca39ce7d-3654-47ba-bac9-da833a907e8d req-650bf0bc-9c70-417d-b75f-3928f58334d3 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:48.330490 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ca39ce7d-3654-47ba-bac9-da833a907e8d req-650bf0bc-9c70-417d-b75f-3928f58334d3 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:48.331021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-ca39ce7d-3654-47ba-bac9-da833a907e8d req-650bf0bc-9c70-417d-b75f-3928f58334d3 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:48.345923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-ca39ce7d-3654-47ba-bac9-da833a907e8d req-650bf0bc-9c70-417d-b75f-3928f58334d3 service nova] Creating event network-changed:86a606d0-4e07-41bc-9330-5f9413303abc for instance 3e61328a-974d-4929-a32b-c273cfccc860 on hv-cinder-86021 Oct 04 12:09:48.351757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-ca39ce7d-3654-47ba-bac9-da833a907e8d req-650bf0bc-9c70-417d-b75f-3928f58334d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038106 Oct 04 12:09:48.352428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 399/656] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:48.591973 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:48.593916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:48.606437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:48.607553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:48.609343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:48.611106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:48.612067 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:48.613145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:48.639344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] HTTP exception thrown: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Request method failure captured: Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 HTTP/1.1 Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFwpKaz-RMTzx_rkW00ChzjrFblqZSI_vj9m7jBIo-l2oh0ZEAF3zg2HiCXdtJ3YuiGlHPybeygWtXzGR9XtOQsLr1F4JUtmn8a2vcSEPzTCwmi1XrkYSl-2fkLI_xV8PqKGmRfCsSnKL4pXT2RETlvSBxu_QgbWY5jXB1P0Yh3LqA Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:09:48.642710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d4da0e2bff704d7a944445d0011a8667", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}] Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 76771369a0df4c5189e42291ebdf9d24 Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:09:48.644821 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'fe5b93b6-ec32-4534-b51b-15e8eeb734d1'} Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:09:48.645688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:09:48.646950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:09:48.650317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Returning 404 to user: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:09:48.650317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cb941b95-fbf1-47e1-b53f-dca57dc2d251 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 404 len: 111 microversion: 2.1 time: 0.060020 Oct 04 12:09:48.650317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 400/657] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:48 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:09:48.800836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1418263021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-25342910", "security_groups": [{"name": "tempest-secgroup-smoke-1755792237"}], "block_device_mapping_v2": [{"uuid": "b5825f32-5844-44bc-84ea-ddc169a658f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5762fef7-720d-4252-ae68-656d8eb02e71"}]}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:48.947950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] validate_networks() for [('5762fef7-720d-4252-ae68-656d8eb02e71', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:09:49.392685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:09:49.393095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:09:49.393601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:09:49.393979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:09:49.394388 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:09:49.406139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:49.406628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:49.407076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:49.407805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:49.408295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:49.408726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:49.428884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for project d4da0e2bff704d7a944445d0011a8667. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:09:49.433588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for user 76771369a0df4c5189e42291ebdf9d24 and project d4da0e2bff704d7a944445d0011a8667. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:09:49.498237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:09:49.501143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5825f32-5844-44bc-84ea-ddc169a658f6',volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:09:49.966442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8f67a728-21a3-4fba-9114-dc698961467d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.175118 Oct 04 12:09:49.968618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 401/658] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:09:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:09:49.986736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ecb458f3-e0ea-4303-8a50-255a7d92d29d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:49.987611 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ecb458f3-e0ea-4303-8a50-255a7d92d29d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:50.060032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ecb458f3-e0ea-4303-8a50-255a7d92d29d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:50.073492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ecb458f3-e0ea-4303-8a50-255a7d92d29d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1093 microversion: 2.1 time: 0.092859 Oct 04 12:09:50.084572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 402/659] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:49 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:51.101860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:51.102551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:51.110458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:51.110947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:51.111374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:51.112094 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:51.112566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:51.113016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:51.180232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:51.190173 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a71b3ac1-840d-44b9-bbee-e315e4223103 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1143 microversion: 2.1 time: 0.092184 Oct 04 12:09:51.190830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 403/660] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:51 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:52.214818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:52.215898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:52.223302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:52.223831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:52.224318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:52.225046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:52.225715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:52.226191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:52.300749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:52.311027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3190b9b1-5679-4812-9487-e56c07f95302 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1191 microversion: 2.1 time: 0.100239 Oct 04 12:09:52.312569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 404/661] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:52 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:53.338272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:53.340687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:53.350635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:53.351307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:53.352351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:53.353228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:53.353721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:53.354491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:53.423986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:53.438347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2ab98c44-324a-45b4-8b19-80a98d469ce4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1199 microversion: 2.1 time: 0.104168 Oct 04 12:09:53.443534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 405/662] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:53 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:54.463233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:54.464231 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:54.471777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:54.472296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:54.472739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:54.473460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:54.473910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:54.474337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:54.551637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:54.571130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-15cb341f-abe9-45c5-925c-166279ae9d3a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1209 microversion: 2.1 time: 0.111659 Oct 04 12:09:54.572319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 406/663] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:54 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:55.047921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:55.050617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:55.058238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:55.058993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:55.059665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:55.060753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:55.073549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:55.073549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:55.101795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9930a5a7-afd9-4734-88bc-fe247518d5a2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058531 Oct 04 12:09:55.102721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 407/664] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:09:55 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:55.121442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:55.122516 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:55.136887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:55.137831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:55.138692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:55.140629 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:55.141538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:55.142314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:55.200958 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7ba44939-9860-4d85-907c-727dda427a8b tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/2b6279d2-574f-4105-bab1-69ab9401fb62" status: 200 len: 194 microversion: 2.1 time: 0.089126 Oct 04 12:09:55.202073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 408/665] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Oct 4 12:09:55 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/2b6279d2-574f-4105-bab1-69ab9401fb62 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:55.613432 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:55.614384 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:55.623876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:55.625279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:55.625985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:55.627602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:55.628203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:55.629005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:55.848232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:55.863195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c7ffaa2c-d10d-473d-ae5b-98e72191c151 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1277 microversion: 2.1 time: 0.256124 Oct 04 12:09:55.864267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 409/666] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:55 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:55.933708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-10e20328-c62d-4333-bccb-e7d6954b9242 req-725ec03c-78e1-4f04-8caa-ffafe1aced53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11aa9f19-db2a-476a-9a38-848192aa612c", "tag": "853bd174-966e-4864-a482-32138d73cdea"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:55.947241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-10e20328-c62d-4333-bccb-e7d6954b9242 req-725ec03c-78e1-4f04-8caa-ffafe1aced53 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:55.948142 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-10e20328-c62d-4333-bccb-e7d6954b9242 req-725ec03c-78e1-4f04-8caa-ffafe1aced53 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:55.948915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-10e20328-c62d-4333-bccb-e7d6954b9242 req-725ec03c-78e1-4f04-8caa-ffafe1aced53 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:56.213015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-10e20328-c62d-4333-bccb-e7d6954b9242 req-725ec03c-78e1-4f04-8caa-ffafe1aced53 service nova] Creating event network-changed:853bd174-966e-4864-a482-32138d73cdea for instance 11aa9f19-db2a-476a-9a38-848192aa612c on hv-cinder-86021 Oct 04 12:09:56.218898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-10e20328-c62d-4333-bccb-e7d6954b9242 req-725ec03c-78e1-4f04-8caa-ffafe1aced53 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289453 Oct 04 12:09:56.219522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 410/667] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:09:56.903719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:56.904460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:56.911097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:56.911626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:56.912093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:56.912838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:56.913286 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:56.913721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:57.065848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:57.074762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5fd5b348-086c-458d-b102-1bc3e2d66517 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.175973 Oct 04 12:09:57.075382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 411/668] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:56 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:57.202992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6205970-7c35-4ef9-a420-65f5f124f1ad"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:09:57.206662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:57.217771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:57.218660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:57.219477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:57.220794 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:57.221635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:57.222404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:58.382686 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a1f39273-1208-4778-8664-f1469518dd62 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "POST /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.187207 Oct 04 12:09:58.383550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 412/669] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:09:57 2022] POST /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments => generated 194 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:09:58.388815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:58.394316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:58.397288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:58.397820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:58.398263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:58.398990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:58.399456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:58.399886 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:58.574364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:58.589842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-193726f2-6b51-41f7-bc59-df6215cea32c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.204846 Oct 04 12:09:58.590917 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 413/670] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:58 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:09:59.614199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:59.615015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:59.618853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:59.625946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:59.626734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:59.627188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:59.627940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:59.628433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:59.628879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:59.649773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:09:59.831182 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:09:59.842161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a9f0dadd-be1c-40b8-b750-ddc11ec0ff27 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.231711 Oct 04 12:09:59.842845 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 414/671] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:09:59 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:09:59.907766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:09:59.908627 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:09:59.919200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:59.920061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:59.921276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:09:59.922114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:09:59.922728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:09:59.923440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.016395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lazy-loading 'services' on Instance uuid 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:00.066650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=8 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:00.357227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-94f1d600-2b9c-4549-a58c-79955aae975f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments/c6677180-dc19-448e-ab09-3197ef14120e" status: 202 len: 0 microversion: 2.1 time: 0.457418 Oct 04 12:10:00.357832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 415/672] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:09:59 2022] DELETE /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments/c6677180-dc19-448e-ab09-3197ef14120e => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:10:00.367525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:00.369904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:00.376337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.377105 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.377577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.378278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.378726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.379145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.410284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0176e9cf-ca4b-4ab0-bc28-36123e71742c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047095 Oct 04 12:10:00.410881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 416/673] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:00 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:00.883952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:00.884797 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:00.892574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.893072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.893514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:00.894224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:00.894690 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:00.895117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:01.044997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:01.053326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f9ec6497-1770-44b0-8c66-5ca34728f554 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.175682 Oct 04 12:10:01.053908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 417/674] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:00 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:01.426232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:01.429373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:01.438509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:01.439086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:01.439534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:01.440301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:01.440758 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:01.441179 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:01.477313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8bf8573f-2f4a-457d-abb9-74cbc6b0ac8a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056370 Oct 04 12:10:01.477894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 418/675] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:01 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:02.077223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:02.077951 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:02.084917 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:02.085414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:02.085873 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:02.086587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:02.087044 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:02.087470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:02.245563 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:02.260312 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9ce4f228-2e7f-44d9-80d5-3dbbef402e65 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.186886 Oct 04 12:10:02.261378 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 419/676] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:02 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:02.490266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:02.492681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:02.499219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:02.499714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:02.500156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:02.500928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:02.501634 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:02.502069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:02.551265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a7888793-0f7c-4b35-9daf-69d0a40c9f36 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064728 Oct 04 12:10:02.552369 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 420/677] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:02 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:03.286211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:03.286987 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:03.293861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:03.294364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:03.294803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:03.296351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:03.296967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:03.297471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:03.455340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:03.468188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-25301209-cb85-4dbc-bdc0-f0deb43039de tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.185045 Oct 04 12:10:03.472963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 421/678] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:03 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:03.565732 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:03.568148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:03.576081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:03.580517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:03.580517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:03.580517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:03.580517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:03.581195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:03.616908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e6c32a03-d721-47da-9070-cd1c88bb3375 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055636 Oct 04 12:10:03.617502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 422/679] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:03 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:04.494253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:04.495425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:04.503667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:04.504361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:04.504854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:04.505633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:04.506180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:04.506651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:04.659856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:04.668692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-946b8722-2939-4217-9cb2-44bf97c234f0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.178694 Oct 04 12:10:04.669318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 423/680] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:04 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:04.674838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:04.677153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:04.683898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:04.684431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:04.684879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:04.685777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:04.686829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:04.687261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:04.721032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-857290fe-d0f0-477f-8ff7-383158ed7027 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050590 Oct 04 12:10:04.721616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 424/681] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:04 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:05.707625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:05.708493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:05.715706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:05.716337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:05.716783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:05.717505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:05.717992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:05.718421 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:05.871331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:05.881260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-26033c16-c0a5-467c-8143-cf8dce9362c4 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.177645 Oct 04 12:10:05.881872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 425/682] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:05 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:05.886954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:05.889869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:05.896708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:05.897214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:05.897654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:05.898393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:05.898860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:05.899293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:05.944042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e456304e-aad1-4bc4-b935-561ad526e1b0 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061047 Oct 04 12:10:05.945043 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 426/683] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:05 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:06.912941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:06.913656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:06.920454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:06.920951 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:06.921390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:06.922119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:06.922575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:06.923010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.127010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:07.135753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-18198390-1fd6-4a83-8652-a4c779257a7a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.226497 Oct 04 12:10:07.136833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 427/684] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:06 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:07.146527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:07.150533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:07.162263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.163171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.163918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.165258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.166089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.166865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.203952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0436d08c-439a-423c-952b-5eb84104f779 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065485 Oct 04 12:10:07.204579 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 428/685] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:07 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:07.209765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:07.212068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:07.218882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.219396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.219816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.220619 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.221078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.221510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.258388 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6fb7bdf5-a9cc-46b8-a739-a643b67cb0c2 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052629 Oct 04 12:10:07.258991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 429/686] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:07 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:07.441605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:07.442013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:07.448340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.448844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.449271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.449974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.450422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.450842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.465855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:07.483521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0d249770-ec92-4972-9acd-459fad90f3cc tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/2b6279d2-574f-4105-bab1-69ab9401fb62" status: 200 len: 194 microversion: 2.1 time: 0.045273 Oct 04 12:10:07.484133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 430/687] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Oct 4 12:10:07 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/2b6279d2-574f-4105-bab1-69ab9401fb62 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:07.495557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:07.496259 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:07.504350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.511311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.511311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.511311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:07.511311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:07.511691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:07.613203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lazy-loading 'services' on Instance uuid 22b3f870-4de4-4585-98ce-77ea122df015 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:07.924566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2e43c089-c2d7-4663-ac81-48f1c67fa0c5 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/2b6279d2-574f-4105-bab1-69ab9401fb62" status: 202 len: 0 microversion: 2.1 time: 0.432531 Oct 04 12:10:07.925584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 431/688] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:10:07 2022] DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/2b6279d2-574f-4105-bab1-69ab9401fb62 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:10:08.163577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:08.164321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:08.172069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:08.172592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:08.173045 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:08.173739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:08.174482 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:08.174881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:08.556208 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:10:08.557229 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:10:08.645272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:08.656550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1eee0de5-d42c-4b95-9987-77b374d68812 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.495889 Oct 04 12:10:08.657252 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 432/689] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:08 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:08.664537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:08.666728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:08.673123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:08.673612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:08.674051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:08.674763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:08.675223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:08.675648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:08.710652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e0538e19-c03c-4f8a-ad05-c3ab15e07ab6 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052181 Oct 04 12:10:08.711233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 433/690] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:08 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:10:08.715904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-05c8d395-d8c1-47d2-86a5-0b19982f17e3 req-65da283d-7d13-449b-92f9-19477236decf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11aa9f19-db2a-476a-9a38-848192aa612c", "name": "network-vif-plugged", "status": "completed", "tag": "853bd174-966e-4864-a482-32138d73cdea"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:08.726073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-05c8d395-d8c1-47d2-86a5-0b19982f17e3 req-65da283d-7d13-449b-92f9-19477236decf service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:08.726796 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-05c8d395-d8c1-47d2-86a5-0b19982f17e3 req-65da283d-7d13-449b-92f9-19477236decf service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:08.727225 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-05c8d395-d8c1-47d2-86a5-0b19982f17e3 req-65da283d-7d13-449b-92f9-19477236decf service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:08.739752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-05c8d395-d8c1-47d2-86a5-0b19982f17e3 req-65da283d-7d13-449b-92f9-19477236decf service nova] Creating event network-vif-plugged:853bd174-966e-4864-a482-32138d73cdea for instance 11aa9f19-db2a-476a-9a38-848192aa612c on hv-cinder-86021 Oct 04 12:10:08.744724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-05c8d395-d8c1-47d2-86a5-0b19982f17e3 req-65da283d-7d13-449b-92f9-19477236decf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032300 Oct 04 12:10:08.745320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 434/691] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:08.815605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:08.816147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:08.823106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:08.823602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:08.824038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:08.824807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:08.825346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:08.825773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:08.868527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:10:09.172489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:09.327411 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-69c10563-ffce-4ec6-a926-98ec369840aa tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 204 len: 0 microversion: 2.1 time: 0.517166 Oct 04 12:10:09.328503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 435/692] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:08 2022] DELETE /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:10:09.338840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:09.339635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:09.350061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.350948 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.351728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.353318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.354165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.354938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.532882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:09.549085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-89fa7893-8683-43cb-ac07-be841cbe189a tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1688 microversion: 2.1 time: 0.214039 Oct 04 12:10:09.550481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 436/693] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:09 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1688 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:09.679644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:09.680306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:09.686782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.687267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.687699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.688431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:09.688873 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:09.689302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:09.844998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:09.854318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ed43340d-7a5d-4e87-b1be-f81e0e620576 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.178675 Oct 04 12:10:09.854893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 437/694] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:09 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:10.576963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:10.577662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:10.585142 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:10.585747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:10.586230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:10.586970 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:10.587453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:10.587915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:10.745640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:10.754303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-797a71cb-1eb9-4318-895b-213874914c62 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1688 microversion: 2.1 time: 0.182390 Oct 04 12:10:10.754897 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 438/695] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:10 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:10.878991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:10.879606 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:10.886069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:10.886551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:10.886996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:10.887699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:10.888158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:10.888606 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:11.043731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:11.052124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-20276e5d-eaf4-487e-b2bf-d52f71b044ec tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.177237 Oct 04 12:10:11.052731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 439/696] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:10 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:11.796255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:11.797826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:11.810027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:11.810847 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:11.811651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:11.813014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:11.813876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:11.814712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:11.970964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:11.979735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f09486ee-758e-42cf-aa4d-2970e3fe07bb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1688 microversion: 2.1 time: 0.190972 Oct 04 12:10:11.980441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 440/697] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:11 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:12.077270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:12.077818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:12.084365 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:12.084858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:12.085299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:12.086016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:12.086478 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:12.086924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:12.262544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:12.284942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-66262bb9-6e41-4d33-8b5c-7ba3889bc34c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.200145 Oct 04 12:10:12.284942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 441/698] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:12 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:13.004627 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:13.005363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:13.012317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:13.012816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:13.013299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:13.014084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:13.014543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:13.014974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:13.180366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:13.188374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-83c1598f-4317-4de7-ad25-f8cf772b2b84 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1688 microversion: 2.1 time: 0.188230 Oct 04 12:10:13.188968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 442/699] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:12 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:13.301957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:13.303002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:13.312564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:13.313101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:13.313541 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:13.314271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:13.314725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:13.315158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:13.471707 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:13.483470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-094d5f1f-9e57-4a32-b490-9a7789ff2e05 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.187618 Oct 04 12:10:13.484695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 443/700] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:13 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:14.216617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:14.217833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:14.233347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.234256 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.235053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.236460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.237612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.238420 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.441130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:14.457124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-23d77219-b3a7-468d-b151-3e62a149087f tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1688 microversion: 2.1 time: 0.248703 Oct 04 12:10:14.458137 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 444/701] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:14 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:14.467228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:14.468231 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:14.480154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.481116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.481908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.483857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.484772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.485574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.515375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:14.548685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-34b67198-e47f-4a3a-919f-56fb7671a41e tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/e6205970-7c35-4ef9-a420-65f5f124f1ad" status: 200 len: 194 microversion: 2.1 time: 0.088489 Oct 04 12:10:14.550178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 445/702] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Oct 4 12:10:14 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/e6205970-7c35-4ef9-a420-65f5f124f1ad => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:14.558845 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:14.562198 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:14.571818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.572969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.573774 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.575143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.575992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.576853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.760991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:14.770422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ae4d2a76-7d5f-461c-ad30-c13a76fb4a08 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1265 microversion: 2.1 time: 0.218930 Oct 04 12:10:14.771712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 446/703] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:14 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:14.776858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:14.777424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:14.797947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.798769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.799446 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.800802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:14.802402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:14.802882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:14.900589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lazy-loading 'services' on Instance uuid 22b3f870-4de4-4585-98ce-77ea122df015 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:15.245215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ab2af1d0-880b-4d38-86a0-dc3421df8750 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/e6205970-7c35-4ef9-a420-65f5f124f1ad" status: 202 len: 0 microversion: 2.1 time: 0.472349 Oct 04 12:10:15.246220 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 447/704] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:10:14 2022] DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments/e6205970-7c35-4ef9-a420-65f5f124f1ad => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:10:15.256730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-c779acda-5ef2-4e68-888f-e7e4c44de276 req-54f57c73-7d0f-47a6-8e02-e78ead0c2354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a45ae82-9e63-4ac4-84c9-6ec1d61556a8", "name": "network-vif-deleted", "tag": "b026d660-150c-4793-803c-fc2cbcfe5527"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:15.278064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-c779acda-5ef2-4e68-888f-e7e4c44de276 req-54f57c73-7d0f-47a6-8e02-e78ead0c2354 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:15.278963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-c779acda-5ef2-4e68-888f-e7e4c44de276 req-54f57c73-7d0f-47a6-8e02-e78ead0c2354 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:15.280417 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-c779acda-5ef2-4e68-888f-e7e4c44de276 req-54f57c73-7d0f-47a6-8e02-e78ead0c2354 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:15.305316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-c779acda-5ef2-4e68-888f-e7e4c44de276 req-54f57c73-7d0f-47a6-8e02-e78ead0c2354 service nova] Creating event network-vif-deleted:b026d660-150c-4793-803c-fc2cbcfe5527 for instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 on hv-cinder-86021 Oct 04 12:10:15.319281 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-c779acda-5ef2-4e68-888f-e7e4c44de276 req-54f57c73-7d0f-47a6-8e02-e78ead0c2354 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070529 Oct 04 12:10:15.325491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 448/705] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:15.482877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:15.483710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:15.493144 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:15.493841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:15.494784 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:15.495912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:15.496756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:15.497450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:15.590950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:15.600143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6b9e8af8-0fa0-482c-b58e-36d3c948173e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1621 microversion: 2.1 time: 0.122465 Oct 04 12:10:15.612302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 449/706] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:15 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1621 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:15.813768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:15.814913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:15.827061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:15.827677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:15.828162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:15.828990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:15.829683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:15.830127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:16.040689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:16.053204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-24c656d6-3bc1-4f10-bf79-63ed1630e72e tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1452 microversion: 2.1 time: 0.247841 Oct 04 12:10:16.053983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 450/707] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:15 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1452 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:16.082167 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:16.082819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:16.089635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:16.099552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:16.099552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:16.099552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:16.099552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:16.100159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:16.269254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:16.280035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cf093daf-75f1-4aa9-b266-2f96c49b748b tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1452 microversion: 2.1 time: 0.201095 Oct 04 12:10:16.281053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 451/708] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:16 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:16.633214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:16.634192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:16.641731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:16.642674 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:16.643353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:16.644382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:16.645135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:16.645738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:16.697371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:16.697888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:16.698352 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:16.699036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lazy-loading 'fault' on Instance uuid 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:16.744848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:16.754285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1fdb6f6b-c7ca-4ab7-98e6-9981f461384e tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 200 len: 1336 microversion: 2.1 time: 0.125517 Oct 04 12:10:16.770926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 452/709] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:16 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 1336 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:17.641503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:17.645347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:17.652800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:17.653346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:17.653829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:17.655110 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:17.655578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:17.656010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:17.691572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d02e011f-e7cb-4b6d-8ca4-81c43b2518cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054525 Oct 04 12:10:17.692218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 453/710] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:17 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 12:10:17.778481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:17.779618 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:17.788536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:17.788781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:17.789164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:17.790080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:17.790537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:17.790957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:17.810940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] HTTP exception thrown: Instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 could not be found. Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Request method failure captured: Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 HTTP/1.1 Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFKc-ROR5mjgB7LUfF_a4N3_Cx_fLmicq3mvRA9LKnchZ3ZfxgDtwvu51UJzf6DPqiBtokCrYUNA6TNQnkupldIz4SVhh5J73GqMUyVnKJ3QlaVNFi3s47mg9CcRdziYH06w8xQIEU4H7vZ1_s_tf8ivpsIzpDWzLmFuC1vn9kKPW8 Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:17.813258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f4f180049cc049829e12eace469bef05", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}] Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: f3f607e48e534dd09c3619982978e9e5 Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 could not be found. Oct 04 12:10:17.815100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '9a45ae82-9e63-4ac4-84c9-6ec1d61556a8'} Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 could not be found. Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:17.816010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 could not be found. Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 could not be found. Oct 04 12:10:17.817548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:17.819756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Returning 404 to user: Instance 9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:17.820669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9ea3d427-a61a-4dcf-96d1-ec300562b090 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8" status: 404 len: 111 microversion: 2.1 time: 0.046165 Oct 04 12:10:17.821228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 454/711] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:17 2022] GET /compute/v2.1/servers/9a45ae82-9e63-4ac4-84c9-6ec1d61556a8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:17.830768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d6385aa0-bac5-4152-a347-aa2994adefbb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '.version_select at 0x7f10c36ef700>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:17.961925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d6385aa0-bac5-4152-a347-aa2994adefbb tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858151413" status: 202 len: 0 microversion: 2.1 time: 0.135479 Oct 04 12:10:17.964812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 455/712] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Oct 4 12:10:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858151413 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:10:17.971029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:17.973386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:17.981261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:17.981746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:17.983099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:17.983683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:17.984128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:17.984577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:18.028861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d61e5d19-b69f-4938-b8e8-08628964325d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063964 Oct 04 12:10:18.029890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 456/713] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:17 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:10:18.130081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:18.131100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:18.141809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:18.143774 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:18.144741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:18.145903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:18.146597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:18.147223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:18.187198 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:10:18.578583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bb412095-d9d1-4f33-a74f-c09b21399e31 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 204 len: 0 microversion: 2.1 time: 0.457836 Oct 04 12:10:18.580113 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 457/714] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:18 2022] DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:10:18.601226 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:18.602900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:18.616442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:18.617760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:18.618558 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:18.620222 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:18.620892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:18.621646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:18.906062 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:18.929585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9eb5612e-7ff0-4fb3-913f-f3d11167a56c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1672 microversion: 2.1 time: 0.329993 Oct 04 12:10:18.929585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 458/715] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:18 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1672 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:19.028864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-6252bb34-8631-4c2d-900c-92ccc2e44852 req-16b73809-e997-47bc-8bb9-fd2bf8ceda66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11aa9f19-db2a-476a-9a38-848192aa612c", "tag": "853bd174-966e-4864-a482-32138d73cdea"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:19.040420 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6252bb34-8631-4c2d-900c-92ccc2e44852 req-16b73809-e997-47bc-8bb9-fd2bf8ceda66 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:19.040945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6252bb34-8631-4c2d-900c-92ccc2e44852 req-16b73809-e997-47bc-8bb9-fd2bf8ceda66 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:19.041506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6252bb34-8631-4c2d-900c-92ccc2e44852 req-16b73809-e997-47bc-8bb9-fd2bf8ceda66 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:19.054915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-6252bb34-8631-4c2d-900c-92ccc2e44852 req-16b73809-e997-47bc-8bb9-fd2bf8ceda66 service nova] Creating event network-changed:853bd174-966e-4864-a482-32138d73cdea for instance 11aa9f19-db2a-476a-9a38-848192aa612c on hv-cinder-86021 Oct 04 12:10:19.061017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-6252bb34-8631-4c2d-900c-92ccc2e44852 req-16b73809-e997-47bc-8bb9-fd2bf8ceda66 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036809 Oct 04 12:10:19.061975 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 459/716] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:19.946020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:19.947097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:19.959967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:19.960898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:19.962262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:19.963574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:19.964401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:19.965229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:20.167869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:20.177621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-49c733f4-6d2e-45dd-8e93-f3c3a665c990 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1672 microversion: 2.1 time: 0.240313 Oct 04 12:10:20.178216 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 460/717] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:19 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:21.202986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:21.204051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:21.211428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:21.212139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:21.212617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:21.213345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:21.213807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:21.214403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:21.425326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:21.435785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d4205d55-4c4c-43ce-8394-478f687b97e6 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1672 microversion: 2.1 time: 0.237017 Oct 04 12:10:21.436427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 461/718] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:21 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:21.948279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:21.948795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:21.956403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:21.957270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:21.957932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:21.958700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:21.959156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:21.959786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:21.978383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:21.991979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:10:22.486827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0a766293-78bd-4c64-9d12-d2d58051a48c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 204 len: 0 microversion: 2.1 time: 0.535211 Oct 04 12:10:22.486827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 462/719] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:21 2022] DELETE /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:10:22.498126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:22.499583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:22.512042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:22.513161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:22.514673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:22.516056 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:22.517247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:22.530963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:22.657648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:22.671894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-39cceaf0-b87f-4b79-a417-79d5816c680d tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1605 microversion: 2.1 time: 0.181697 Oct 04 12:10:22.676923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 463/720] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:22 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1605 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:22.687855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:22.690676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:22.705819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:22.706696 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:22.707497 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:22.708849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:22.709706 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:22.710482 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:22.895131 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:22.905612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-31fa7984-7f17-461d-abb6-a8492211ecb9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1504 microversion: 2.1 time: 0.226244 Oct 04 12:10:22.906245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 464/721] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:22 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:22.926335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-2c9bcdfa-19d8-4eb3-b205-e4e6de54b925 req-89155f97-24c7-4ab7-a8a3-85f348548d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b3f870-4de4-4585-98ce-77ea122df015", "name": "network-vif-deleted", "tag": "37e28375-5f84-47c0-8196-4faed5327646"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:22.936540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-2c9bcdfa-19d8-4eb3-b205-e4e6de54b925 req-89155f97-24c7-4ab7-a8a3-85f348548d52 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:22.937027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-2c9bcdfa-19d8-4eb3-b205-e4e6de54b925 req-89155f97-24c7-4ab7-a8a3-85f348548d52 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:22.937480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-2c9bcdfa-19d8-4eb3-b205-e4e6de54b925 req-89155f97-24c7-4ab7-a8a3-85f348548d52 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:22.949855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-2c9bcdfa-19d8-4eb3-b205-e4e6de54b925 req-89155f97-24c7-4ab7-a8a3-85f348548d52 service nova] Creating event network-vif-deleted:37e28375-5f84-47c0-8196-4faed5327646 for instance 22b3f870-4de4-4585-98ce-77ea122df015 on hv-cinder-86021 Oct 04 12:10:22.955774 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-2c9bcdfa-19d8-4eb3-b205-e4e6de54b925 req-89155f97-24c7-4ab7-a8a3-85f348548d52 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034134 Oct 04 12:10:22.956433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 465/722] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:23.714755 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:23.715967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:23.723651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:23.724371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:23.725140 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:23.725722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:23.726235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:23.726830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:23.821501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:23.831947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b9919c79-7ff9-4080-a7c7-be92c910206c tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1605 microversion: 2.1 time: 0.125484 Oct 04 12:10:23.832581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 466/723] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:23 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1605 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:23.938880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:23.940070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:23.951102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:23.970196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:23.970196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:23.970196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:23.970196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:23.970744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:24.131736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:24.146621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-508f8f3a-716c-4f19-8204-89a725ca5733 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1504 microversion: 2.1 time: 0.216040 Oct 04 12:10:24.148263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 467/724] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:23 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:24.871591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:24.874434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:24.882868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:24.883757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:24.885997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:24.885997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:24.885997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:24.886552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:24.927164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:24.927654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:24.928129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:24.928639 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lazy-loading 'fault' on Instance uuid 22b3f870-4de4-4585-98ce-77ea122df015 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:24.980679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd040e13fd6c4b0dbea6a65932f84cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb043e789a6467db5465a0107f41076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:24.991621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c569e2f3-e7c9-4aef-b767-d610bc8185a0 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 200 len: 1327 microversion: 2.1 time: 0.124110 Oct 04 12:10:24.992767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 468/725] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:24 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:25.003745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-d91947c9-980c-4572-afb9-85dffb3dfc5f req-0effbdb5-412b-4ea0-9871-84001862f007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0451fc1-f1f4-40fb-bf24-186562ff1514", "name": "network-vif-deleted", "tag": "963f263d-76df-47c8-9d84-157b7812a5a5"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:25.022370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d91947c9-980c-4572-afb9-85dffb3dfc5f req-0effbdb5-412b-4ea0-9871-84001862f007 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:25.023562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d91947c9-980c-4572-afb9-85dffb3dfc5f req-0effbdb5-412b-4ea0-9871-84001862f007 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:25.024423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d91947c9-980c-4572-afb9-85dffb3dfc5f req-0effbdb5-412b-4ea0-9871-84001862f007 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:25.047825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-d91947c9-980c-4572-afb9-85dffb3dfc5f req-0effbdb5-412b-4ea0-9871-84001862f007 service nova] Creating event network-vif-deleted:963f263d-76df-47c8-9d84-157b7812a5a5 for instance a0451fc1-f1f4-40fb-bf24-186562ff1514 on hv-cinder-86021 Oct 04 12:10:25.057302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-d91947c9-980c-4572-afb9-85dffb3dfc5f req-0effbdb5-412b-4ea0-9871-84001862f007 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058636 Oct 04 12:10:25.058392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 469/726] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:25.186076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:25.187368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:25.202426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:25.203503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:25.204291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:25.208093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:25.208093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:25.208093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:25.332453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:25.349830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ed711c4f-37fe-4680-91d7-41a7511bbda9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1290 microversion: 2.1 time: 0.169837 Oct 04 12:10:25.351303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 470/727] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:25 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1290 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:26.031377 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:26.032449 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:26.044573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:26.045475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:26.046278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:26.047620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:26.048510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:26.049301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:26.074123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] HTTP exception thrown: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Request method failure captured: Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 HTTP/1.1 Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDiP7Pj4b4fPcuDvnXmdKT8_Zw7UloUTZVYYO_vN_na7Xm9gU2HzCQHlozQxbIVdg6fqmGPa30U6IDP4QKmcky4T-EDBa55aT-NsCarxllU9JbdJv6JaPB9-vamwc6P-v9Ck4Y-fvj5dUdwf5eoa6axQm6_LGU5ELY7rPf1pbf_0ig Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:26.076550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4eb043e789a6467db5465a0107f41076", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}] Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fd040e13fd6c4b0dbea6a65932f84cb2 Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:26.079055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '22b3f870-4de4-4585-98ce-77ea122df015'} Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:26.080702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:26.083298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:26.095666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Returning 404 to user: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:26.095666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fda3dd27-45db-48be-9df7-7483de97a8cf tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 404 len: 111 microversion: 2.1 time: 0.054253 Oct 04 12:10:26.095666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 471/728] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:26 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:26.103668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-734f362f-9c24-4164-a934-acc35bc0fcf8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '.version_select at 0x7f10c3693d30>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:26.321319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-734f362f-9c24-4164-a934-acc35bc0fcf8 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501637330" status: 202 len: 0 microversion: 2.1 time: 0.222260 Oct 04 12:10:26.321834 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 472/729] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Oct 4 12:10:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501637330 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:10:26.379819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:26.380819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:26.384098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:26.393596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:26.396540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:26.396540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:26.396902 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:26.397524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:26.398268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:26.484702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:26.485769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:26.486572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:26.487653 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lazy-loading 'fault' on Instance uuid a0451fc1-f1f4-40fb-bf24-186562ff1514 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:26.548786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:26.557602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-47fae73a-6975-43de-9c32-e7a2a9a5ac82 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 200 len: 1309 microversion: 2.1 time: 0.186345 Oct 04 12:10:26.558302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 473/730] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:26 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 1309 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:27.584627 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:27.585547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: a0451fc1-f1f4-40fb-bf24-186562ff1514] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:27.593907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:27.594317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:27.594761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:27.595537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:27.595997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:27.596457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:27.611772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] HTTP exception thrown: Instance a0451fc1-f1f4-40fb-bf24-186562ff1514 could not be found. Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Request method failure captured: Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 HTTP/1.1 Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFKc-ROR5mjgB7LUfF_a4N3_Cx_fLmicq3mvRA9LKnchZ3ZfxgDtwvu51UJzf6DPqiBtokCrYUNA6TNQnkupldIz4SVhh5J73GqMUyVnKJ3QlaVNFi3s47mg9CcRdziYH06w8xQIEU4H7vZ1_s_tf8ivpsIzpDWzLmFuC1vn9kKPW8 Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:27.613373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f4f180049cc049829e12eace469bef05", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}] Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: f3f607e48e534dd09c3619982978e9e5 Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance a0451fc1-f1f4-40fb-bf24-186562ff1514 could not be found. Oct 04 12:10:27.622181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'a0451fc1-f1f4-40fb-bf24-186562ff1514'} Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0451fc1-f1f4-40fb-bf24-186562ff1514 could not be found. Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:27.623483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0451fc1-f1f4-40fb-bf24-186562ff1514 could not be found. Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0451fc1-f1f4-40fb-bf24-186562ff1514 could not be found. Oct 04 12:10:27.624767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:27.626090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Returning 404 to user: Instance a0451fc1-f1f4-40fb-bf24-186562ff1514 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:27.626090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f1957570-a538-4113-aa90-cd8a338ab7a2 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514" status: 404 len: 111 microversion: 2.1 time: 0.035338 Oct 04 12:10:27.626090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 474/731] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:27 2022] GET /compute/v2.1/servers/a0451fc1-f1f4-40fb-bf24-186562ff1514 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:27.626090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:27.626625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:27.632968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:27.633460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:27.633904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:27.634689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:27.635119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:27.635533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:27.662906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:10:28.043099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e218b081-9371-4520-82d3-6544f218d3b4 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "DELETE /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 204 len: 0 microversion: 2.1 time: 0.421231 Oct 04 12:10:28.047645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 475/732] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:27 2022] DELETE /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:10:28.057974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:28.058603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:28.066436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:28.066996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:28.067487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:28.068422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:28.068932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:28.069403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:28.241665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:28.252873 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-020d5b58-c007-457d-848a-01ec0099db40 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.199520 Oct 04 12:10:28.253567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 476/733] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:28 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:29.276891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:29.277608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:29.285526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:29.286048 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:29.286510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:29.287223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:29.287679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:29.288237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:29.436613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:29.454575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9b2d032e-686e-4934-930c-7c1b9c0a29ec tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.172327 Oct 04 12:10:29.454575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 477/734] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:29 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:29.866836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:29.867727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:29.877311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:29.877938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:29.878499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:29.879414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:29.879971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:29.880539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:29.896871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] HTTP exception thrown: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Request method failure captured: Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 HTTP/1.1 Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDiP7Pj4b4fPcuDvnXmdKT8_Zw7UloUTZVYYO_vN_na7Xm9gU2HzCQHlozQxbIVdg6fqmGPa30U6IDP4QKmcky4T-EDBa55aT-NsCarxllU9JbdJv6JaPB9-vamwc6P-v9Ck4Y-fvj5dUdwf5eoa6axQm6_LGU5ELY7rPf1pbf_0ig Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:29.898599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4eb043e789a6467db5465a0107f41076", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}] Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fd040e13fd6c4b0dbea6a65932f84cb2 Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.901308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '22b3f870-4de4-4585-98ce-77ea122df015'} Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:29.903123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.905645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.908092 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Returning 404 to user: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:29.908092 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cb7eb09e-7403-4d24-8694-2b7d6684eff7 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 404 len: 111 microversion: 2.1 time: 0.040894 Oct 04 12:10:29.908092 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 478/735] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:29 2022] DELETE /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:10:29.910783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:29.911398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 22b3f870-4de4-4585-98ce-77ea122df015] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:29.918041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:29.918532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:29.918959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:29.920273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:29.920728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:29.921153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:29.939349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] HTTP exception thrown: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Request method failure captured: Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 HTTP/1.1 Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDiP7Pj4b4fPcuDvnXmdKT8_Zw7UloUTZVYYO_vN_na7Xm9gU2HzCQHlozQxbIVdg6fqmGPa30U6IDP4QKmcky4T-EDBa55aT-NsCarxllU9JbdJv6JaPB9-vamwc6P-v9Ck4Y-fvj5dUdwf5eoa6axQm6_LGU5ELY7rPf1pbf_0ig Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:29.940995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4eb043e789a6467db5465a0107f41076", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}] Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fd040e13fd6c4b0dbea6a65932f84cb2 Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.943880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '22b3f870-4de4-4585-98ce-77ea122df015'} Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:29.945689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. Oct 04 12:10:29.948437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:29.950877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Returning 404 to user: Instance 22b3f870-4de4-4585-98ce-77ea122df015 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:29.950877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fc7e5381-a7c5-46bb-a921-87ad02f49e14 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015" status: 404 len: 111 microversion: 2.1 time: 0.035719 Oct 04 12:10:29.950877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 479/736] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:29 2022] GET /compute/v2.1/servers/22b3f870-4de4-4585-98ce-77ea122df015 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:30.475021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:30.476076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:30.489108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:30.489957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:30.490763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:30.492061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:30.492959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:30.493742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:30.502578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:30.675157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:30.685451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a66d235d-839f-43d2-b438-2f4d7ae73d38 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1521 microversion: 2.1 time: 0.218988 Oct 04 12:10:30.686136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 480/737] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:30 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:31.312474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:31.313150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:31.321946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.322713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.323242 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.324049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.324654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.325234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.342305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] HTTP exception thrown: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Request method failure captured: Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d HTTP/1.1 Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDiP7Pj4b4fPcuDvnXmdKT8_Zw7UloUTZVYYO_vN_na7Xm9gU2HzCQHlozQxbIVdg6fqmGPa30U6IDP4QKmcky4T-EDBa55aT-NsCarxllU9JbdJv6JaPB9-vamwc6P-v9Ck4Y-fvj5dUdwf5eoa6axQm6_LGU5ELY7rPf1pbf_0ig Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:31.344423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4eb043e789a6467db5465a0107f41076", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}] Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fd040e13fd6c4b0dbea6a65932f84cb2 Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.347209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '889c6e11-6374-4ec0-aacc-addc853c945d'} Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:31.348511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.354837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.358170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Returning 404 to user: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:31.358170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-82ba324c-ea84-4631-bd2b-8f4f32fa4903 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "DELETE /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 404 len: 111 microversion: 2.1 time: 0.039497 Oct 04 12:10:31.358170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 481/738] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:31 2022] DELETE /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:31.367466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:31.368298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] [instance: 889c6e11-6374-4ec0-aacc-addc853c945d] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:31.376022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.377069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.377656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.378485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.379110 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.379633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.396132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] HTTP exception thrown: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Request method failure captured: Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d HTTP/1.1 Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDiP7Pj4b4fPcuDvnXmdKT8_Zw7UloUTZVYYO_vN_na7Xm9gU2HzCQHlozQxbIVdg6fqmGPa30U6IDP4QKmcky4T-EDBa55aT-NsCarxllU9JbdJv6JaPB9-vamwc6P-v9Ck4Y-fvj5dUdwf5eoa6axQm6_LGU5ELY7rPf1pbf_0ig Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:31.397729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_4eb043e789a6467db5465a0107f41076", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/4eb043e789a6467db5465a0107f41076"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/4eb043e789a6467db5465a0107f41076"}]}] Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 4eb043e789a6467db5465a0107f41076 Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeTestJSON-30029833 Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fd040e13fd6c4b0dbea6a65932f84cb2 Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeTestJSON-30029833-project Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.401244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '889c6e11-6374-4ec0-aacc-addc853c945d'} Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:31.403128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. Oct 04 12:10:31.406596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:31.409141 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] Returning 404 to user: Instance 889c6e11-6374-4ec0-aacc-addc853c945d could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:31.409141 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8c43c603-6639-415d-af2a-643fca683582 tempest-AttachVolumeTestJSON-30029833 tempest-AttachVolumeTestJSON-30029833-project] 10.222.0.15 "GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d" status: 404 len: 111 microversion: 2.1 time: 0.037063 Oct 04 12:10:31.409141 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 482/739] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:31 2022] GET /compute/v2.1/servers/889c6e11-6374-4ec0-aacc-addc853c945d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:31.711293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:31.712422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:31.720231 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.720723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.721160 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.721868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:31.722320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:31.722739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:31.861304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:31.874081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-be62836c-a456-405e-a9a2-23cdfca46c5d tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1479 microversion: 2.1 time: 0.167312 Oct 04 12:10:31.874825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 483/740] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:31 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1479 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:32.254607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-19e5a135-6331-4c76-819a-25fdf2028fb9 req-7a9fd200-ce6e-482f-80af-c8aeed29e5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dbf236-4a32-4b65-b4b5-6e75f778f934", "name": "network-vif-deleted", "tag": "6724c60b-cea7-42fb-a13e-99399f296c39"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:32.279373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-19e5a135-6331-4c76-819a-25fdf2028fb9 req-7a9fd200-ce6e-482f-80af-c8aeed29e5ea service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:32.280017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-19e5a135-6331-4c76-819a-25fdf2028fb9 req-7a9fd200-ce6e-482f-80af-c8aeed29e5ea service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:32.280504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-19e5a135-6331-4c76-819a-25fdf2028fb9 req-7a9fd200-ce6e-482f-80af-c8aeed29e5ea service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:32.294650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-19e5a135-6331-4c76-819a-25fdf2028fb9 req-7a9fd200-ce6e-482f-80af-c8aeed29e5ea service nova] Creating event network-vif-deleted:6724c60b-cea7-42fb-a13e-99399f296c39 for instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 on hv-cinder-86021 Oct 04 12:10:32.303129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-19e5a135-6331-4c76-819a-25fdf2028fb9 req-7a9fd200-ce6e-482f-80af-c8aeed29e5ea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076561 Oct 04 12:10:32.304214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 484/741] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:32.910506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:32.912057 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:32.919927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:32.920452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:32.920892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:32.921614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:32.922112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:32.922598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:32.960131 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:32.960705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:32.961393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:32.961862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lazy-loading 'fault' on Instance uuid 87dbf236-4a32-4b65-b4b5-6e75f778f934 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:33.022087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3f607e48e534dd09c3619982978e9e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f180049cc049829e12eace469bef05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:33.033489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5f36edbd-1431-4a27-bd78-36042c0fe84c tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 200 len: 1312 microversion: 2.1 time: 0.128234 Oct 04 12:10:33.034646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 485/742] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:32 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:34.068556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:34.081100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] [instance: 87dbf236-4a32-4b65-b4b5-6e75f778f934] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:34.091085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:34.091085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:34.091534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:34.092368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:34.092591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:34.093011 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:34.112467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] HTTP exception thrown: Instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 could not be found. Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Request method failure captured: Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 HTTP/1.1 Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFKc-ROR5mjgB7LUfF_a4N3_Cx_fLmicq3mvRA9LKnchZ3ZfxgDtwvu51UJzf6DPqiBtokCrYUNA6TNQnkupldIz4SVhh5J73GqMUyVnKJ3QlaVNFi3s47mg9CcRdziYH06w8xQIEU4H7vZ1_s_tf8ivpsIzpDWzLmFuC1vn9kKPW8 Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:34.113309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f4f180049cc049829e12eace469bef05", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f4f180049cc049829e12eace469bef05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f4f180049cc049829e12eace469bef05"}]}] Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f4f180049cc049829e12eace469bef05 Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-701283523 Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: f3f607e48e534dd09c3619982978e9e5 Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-ServerRescueNegativeTestJSON-701283523-project Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 could not be found. Oct 04 12:10:34.115174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '87dbf236-4a32-4b65-b4b5-6e75f778f934'} Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 could not be found. Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:34.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 could not be found. Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 could not be found. Oct 04 12:10:34.122945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:34.125547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] Returning 404 to user: Instance 87dbf236-4a32-4b65-b4b5-6e75f778f934 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:34.125547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a87f4aa7-c225-4184-abea-90a5b8fed4b9 tempest-ServerRescueNegativeTestJSON-701283523 tempest-ServerRescueNegativeTestJSON-701283523-project] 10.222.0.15 "GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934" status: 404 len: 111 microversion: 2.1 time: 0.055480 Oct 04 12:10:34.125547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 486/743] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:34 2022] GET /compute/v2.1/servers/87dbf236-4a32-4b65-b4b5-6e75f778f934 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:35.037894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:35.040910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:35.046107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:35.046600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:35.047040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:35.047918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:35.048415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:35.048842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:35.075363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b6adad95-89b6-42aa-a9ac-f0fa36710d44 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/ips" status: 200 len: 149 microversion: 2.1 time: 0.041790 Oct 04 12:10:35.076320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 487/744] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:10:35 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:36.891506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53ad79d4-2a79-418e-b25d-49b295f9fbe0"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:36.895275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:36.907941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:36.909288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:36.910425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:36.911603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:36.912956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:36.913804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:38.098726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-af39a757-94f0-4514-9b34-7ed852f457d5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "POST /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212476 Oct 04 12:10:38.100522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 488/745] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:10:36 2022] POST /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments => generated 194 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:42.195372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-904949d8-d0c4-4181-98ca-954520219342 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c3aa7820>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:42.252596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-904949d8-d0c4-4181-98ca-954520219342 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/09d8ad8d-ff26-4428-81d6-dd384ebae106" status: 200 len: 350 microversion: 2.1 time: 0.061964 Oct 04 12:10:42.253386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 489/746] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:10:42 2022] GET /compute/v2.1/os-volumes/09d8ad8d-ff26-4428-81d6-dd384ebae106 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:44.110409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-70fff2f7-839b-4dc1-b754-0668e46b5398 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c38378b0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:44.165245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-70fff2f7-839b-4dc1-b754-0668e46b5398 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/70cbe412-6869-42d0-9fe0-29eb3a799c4f" status: 200 len: 351 microversion: 2.1 time: 0.058168 Oct 04 12:10:44.165245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 490/747] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:10:44 2022] GET /compute/v2.1/os-volumes/70cbe412-6869-42d0-9fe0-29eb3a799c4f => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:46.824207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6ab7acbe-f32e-4536-9a48-bbbb4d6d7bba tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c38de280>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:46.902090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6ab7acbe-f32e-4536-9a48-bbbb4d6d7bba tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/31f9b7c1-207d-440c-9b19-4f6e15f94d4e" status: 200 len: 350 microversion: 2.1 time: 0.080498 Oct 04 12:10:46.902090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 491/748] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:10:46 2022] GET /compute/v2.1/os-volumes/31f9b7c1-207d-440c-9b19-4f6e15f94d4e => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:46.910832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:46.914790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1703645d-3b0b-4b10-8261-be1a2e6e0186 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c3837af0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:47.011459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1703645d-3b0b-4b10-8261-be1a2e6e0186 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.101190 Oct 04 12:10:47.013021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 492/749] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Oct 4 12:10:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:47.047151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-86922e7a-e084-40eb-90e4-18e12c25cf41 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c4f62940>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:47.209923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-86922e7a-e084-40eb-90e4-18e12c25cf41 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.174957 Oct 04 12:10:47.210944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 493/750] 10.222.0.15 () {58 vars in 1149 bytes} [Tue Oct 4 12:10:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:47.215967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:47.217123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:47.226961 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:47.227471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:47.227999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:47.229586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:47.230150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:47.230421 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:47.339659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'services' on Instance uuid 3e61328a-974d-4929-a32b-c273cfccc860 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:47.812491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d4c1e085-8cc2-48cc-8e4c-72bb9b4252fd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments/53ad79d4-2a79-418e-b25d-49b295f9fbe0" status: 202 len: 0 microversion: 2.1 time: 0.600198 Oct 04 12:10:47.817052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 494/751] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:10:47 2022] DELETE /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments/53ad79d4-2a79-418e-b25d-49b295f9fbe0 => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:10:47.823536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c4e1e9ca-7a6e-4c82-9df5-12b5c4fb0414 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c3782940>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:47.926134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c4e1e9ca-7a6e-4c82-9df5-12b5c4fb0414 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.107072 Oct 04 12:10:47.929586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 495/752] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Oct 4 12:10:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:47.939482 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:47.943718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:47.958876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:47.959823 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:47.960703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:47.962268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:47.963448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:47.964489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:48.015703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-eec627a1-d75b-465d-868f-796f822d02dd tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084183 Oct 04 12:10:48.016370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 496/753] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:47 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:48.021482 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d878d41c-91cd-41f2-adc1-0866d3bdfb44 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c3aa74c0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:48.114692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d878d41c-91cd-41f2-adc1-0866d3bdfb44 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095073 Oct 04 12:10:48.114692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 497/754] 10.222.0.15 () {58 vars in 1167 bytes} [Tue Oct 4 12:10:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:48.128253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5f1f20d4-a008-40e0-99e1-a44270bb1ee8 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c38deca0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:48.229941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5f1f20d4-a008-40e0-99e1-a44270bb1ee8 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.105916 Oct 04 12:10:48.230624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 498/755] 10.222.0.15 () {58 vars in 1170 bytes} [Tue Oct 4 12:10:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:48.252477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-38f4ae78-7b6c-4c7b-8f53-7f250950ea6d tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c37704c0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:48.580633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-38f4ae78-7b6c-4c7b-8f53-7f250950ea6d tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.334965 Oct 04 12:10:48.581482 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 499/756] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Oct 4 12:10:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:48.595903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-19907840-b484-4f91-860c-f4dd2f1014b8 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c38dedc0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:48.695542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-19907840-b484-4f91-860c-f4dd2f1014b8 tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102893 Oct 04 12:10:48.714938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 500/757] 10.222.0.15 () {58 vars in 1188 bytes} [Tue Oct 4 12:10:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:48.731376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0920aee6-f61a-41f1-a1f8-236ccc54a25e tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] Calling method '.version_select at 0x7f10c3aa79d0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:48.850149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0920aee6-f61a-41f1-a1f8-236ccc54a25e tempest-VolumesTestJSON-1198942857 tempest-VolumesTestJSON-1198942857-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.127515 Oct 04 12:10:48.851148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 501/758] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Oct 4 12:10:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:49.033651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:49.037902 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:49.047686 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:49.059475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:49.059475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:49.059475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:49.059475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:49.060249 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:49.106823 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-88c9add6-64d8-4220-8831-412d91ad26a9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079303 Oct 04 12:10:49.116901 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 502/759] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:49 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:10:50.125185 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:50.129969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:50.153174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:50.154780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:50.156427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:50.160550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:50.161559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:50.163925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:50.210335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1627bb61-d437-418c-ab1d-5f45aab98bc7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089667 Oct 04 12:10:50.211545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 503/760] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Oct 4 12:10:50 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 12:10:50.329770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:50.330542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:50.341276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:50.342369 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:50.343209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:50.344619 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:50.345512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:50.346301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:50.379677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:10:50.929269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b6dff49c-6731-4557-bbc3-d83ecc839fa7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 204 len: 0 microversion: 2.1 time: 0.608482 Oct 04 12:10:50.931068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 504/761] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:10:50 2022] DELETE /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:10:50.945947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:50.959557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:50.961954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:50.962983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:50.963907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:50.966183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:50.967054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:50.967779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:51.208052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:51.225194 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f0663edc-9ffc-4d48-8378-a94a59191b96 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1682 microversion: 2.1 time: 0.286727 Oct 04 12:10:51.230120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 505/762] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:50 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:51.494971 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-242f83ee-0c5f-4305-9d2d-f6c7d8d1270f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'create', calling method: .version_select at 0x7f10c4e57e50>, body: {"keypair": {"name": "tempest-keypair-1687265955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6+GdxTgT8DtYxNAdKQkCjuvC6ulHNHjTUrKb6nocuvqw89WwiL/pJrK1lXErdkOaTBncb+E9A1Zy3P2/fDCQ0c+/Zpc3G6YZpfUDnllJYRPATCyC6w0ztodzMmRd4ywA=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:51.513601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-242f83ee-0c5f-4305-9d2d-f6c7d8d1270f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for project e41d4317234c458daad66f591d27c6fa. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:10:51.518270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-242f83ee-0c5f-4305-9d2d-f6c7d8d1270f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for user 9ab97a61223f4719add7b3c0f845a319 and project e41d4317234c458daad66f591d27c6fa. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:10:51.695869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-242f83ee-0c5f-4305-9d2d-f6c7d8d1270f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.403434 Oct 04 12:10:51.697024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 506/763] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Oct 4 12:10:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 406 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 12:10:52.250234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:52.251139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:52.259218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:52.259768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:52.263745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:52.263745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:52.263745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:52.263745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:52.471558 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:52.474426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:10:52.481749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4e21ecc0-169e-4927-b5d7-da35068f2919 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1682 microversion: 2.1 time: 0.235941 Oct 04 12:10:52.482516 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 507/764] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:52 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:10:53.508281 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:53.510249 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:53.525780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:53.526588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:53.527065 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:53.528528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:53.529153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:53.529868 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:53.811143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:53.820968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fed70367-7f29-4789-b715-5a3fbd0637c0 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1682 microversion: 2.1 time: 0.317935 Oct 04 12:10:53.821608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 508/765] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:53 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1682 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:54.359859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-33a26dae-8c8e-4498-a9f0-6445c7186f67 req-917687e6-ca6c-4e96-acef-d47b3e077dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e61328a-974d-4929-a32b-c273cfccc860", "name": "network-vif-deleted", "tag": "86a606d0-4e07-41bc-9330-5f9413303abc"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:54.388814 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-33a26dae-8c8e-4498-a9f0-6445c7186f67 req-917687e6-ca6c-4e96-acef-d47b3e077dea service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:54.391086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-33a26dae-8c8e-4498-a9f0-6445c7186f67 req-917687e6-ca6c-4e96-acef-d47b3e077dea service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:54.391698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-33a26dae-8c8e-4498-a9f0-6445c7186f67 req-917687e6-ca6c-4e96-acef-d47b3e077dea service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:54.416811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-33a26dae-8c8e-4498-a9f0-6445c7186f67 req-917687e6-ca6c-4e96-acef-d47b3e077dea service nova] Creating event network-vif-deleted:86a606d0-4e07-41bc-9330-5f9413303abc for instance 3e61328a-974d-4929-a32b-c273cfccc860 on hv-cinder-86021 Oct 04 12:10:54.422823 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-33a26dae-8c8e-4498-a9f0-6445c7186f67 req-917687e6-ca6c-4e96-acef-d47b3e077dea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070103 Oct 04 12:10:54.427530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 509/766] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:10:54.849020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:54.850122 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:54.859218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:54.859827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:54.868068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:54.868068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:54.868068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:54.868068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:54.952116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:54.955671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-51a4ba16-2bf1-4c67-b2b5-0d11e3f39ee8 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1327 microversion: 2.1 time: 0.112215 Oct 04 12:10:54.956203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 510/767] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:54 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:56.001942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:56.001942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:56.006888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:56.007382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:56.007822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:56.008585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:56.009045 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:56.009474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:56.049671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:56.050165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:56.050599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:56.051278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lazy-loading 'fault' on Instance uuid 3e61328a-974d-4929-a32b-c273cfccc860 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:10:56.124098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8d03fe51534f8e867d0f83c3db2d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f021c9955236461abc441e2a31421b8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:56.152483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6559d85e-2eb3-46a4-881d-fbef3af9912e tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 200 len: 1332 microversion: 2.1 time: 0.157675 Oct 04 12:10:56.153425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 511/768] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:55 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 1332 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:10:56.199500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2012074221", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "550b30d0-e72b-4d9f-9e1c-c1995429feb1"}], "security_groups": [{"name": "tempest-securitygroup--283527002"}], "key_name": "tempest-keypair-1687265955", "user_data": "}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:10:56.371521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] validate_networks() for [('550b30d0-e72b-4d9f-9e1c-c1995429feb1', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:10:56.865638 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:10:56.866065 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:10:56.866539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:10:56.866950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:10:56.867382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:10:56.878587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:56.879135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:56.879583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:56.880410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:56.880869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:56.881291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:56.902031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for project e41d4317234c458daad66f591d27c6fa. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:10:56.911539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for user 9ab97a61223f4719add7b3c0f845a319 and project e41d4317234c458daad66f591d27c6fa. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:10:56.930560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:10:56.933579 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:10:57.058997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0994f1e5-9d70-4a0a-9d70-773da1ef2f5d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.866345 Oct 04 12:10:57.064696 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 512/769] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Oct 4 12:10:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 12:10:57.071679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-df28843f-64e4-42d2-aa6a-b71a99732804 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:57.072335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-df28843f-64e4-42d2-aa6a-b71a99732804 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:57.132150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df28843f-64e4-42d2-aa6a-b71a99732804 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:57.141303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df28843f-64e4-42d2-aa6a-b71a99732804 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:57.142942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df28843f-64e4-42d2-aa6a-b71a99732804 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:57.144295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-df28843f-64e4-42d2-aa6a-b71a99732804 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1282 microversion: 2.20 time: 0.077000 Oct 04 12:10:57.144804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 513/770] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:10:57 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:10:57.179410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:57.179921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:57.186458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:57.186955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:57.189330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:57.189330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:57.189330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:57.189330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:57.204299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 HTTP/1.1 Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:10:57.205984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:10:57.211602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '3e61328a-974d-4929-a32b-c273cfccc860'} Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:10:57.213313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:10:57.216127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:10:57.218308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:10:57.218308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-797a49bf-1f0a-4d95-bc46-de108b1309b9 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 404 len: 111 microversion: 2.1 time: 0.032070 Oct 04 12:10:57.218308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 514/771] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:10:57 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:10:57.218308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-65831e5e-c5db-429a-b654-5cdffeffd481 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '.version_select at 0x7f10c35e99d0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:57.448820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-65831e5e-c5db-429a-b654-5cdffeffd481 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848461543" status: 202 len: 0 microversion: 2.1 time: 0.235602 Oct 04 12:10:57.449973 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 515/772] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Oct 4 12:10:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848461543 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:10:58.172213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7544dd22-2126-4e01-ad24-a2d006f0ddcd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:58.173301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7544dd22-2126-4e01-ad24-a2d006f0ddcd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:58.259565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7544dd22-2126-4e01-ad24-a2d006f0ddcd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:58.268743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7544dd22-2126-4e01-ad24-a2d006f0ddcd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:58.270271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7544dd22-2126-4e01-ad24-a2d006f0ddcd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:58.271396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7544dd22-2126-4e01-ad24-a2d006f0ddcd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1282 microversion: 2.20 time: 0.105324 Oct 04 12:10:58.271947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 516/773] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:10:58 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:10:59.299701 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:10:59.301155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:10:59.308086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:59.308666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:59.309113 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:59.309833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:10:59.310290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:10:59.310771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:10:59.379087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:59.389977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:59.390538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:10:59.391673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f89bf782-4e69-429a-bcc8-9b97493b1a8f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1286 microversion: 2.20 time: 0.097068 Oct 04 12:10:59.392263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 517/774] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:10:59 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:11:00.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:00.315575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:00.323646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.324874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.325568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.326441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.327027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.327603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.346224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 HTTP/1.1 Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:00.348005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.350358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '3e61328a-974d-4929-a32b-c273cfccc860'} Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:00.351718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.354608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.362294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:00.362294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e7a9d86b-ad8b-486e-8d79-16156729f4f3 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 404 len: 111 microversion: 2.1 time: 0.039399 Oct 04 12:11:00.362294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 518/775] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:11:00 2022] DELETE /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:00.362294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:00.362294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: 3e61328a-974d-4929-a32b-c273cfccc860] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:00.366605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.367106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.367547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.368316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.369626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.370087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.386139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 HTTP/1.1 Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:00.387703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.390287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '3e61328a-974d-4929-a32b-c273cfccc860'} Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:00.391100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. Oct 04 12:11:00.392454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:00.393660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance 3e61328a-974d-4929-a32b-c273cfccc860 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:00.393660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c4b45538-fd37-4c24-80d2-a805fa09d18c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860" status: 404 len: 111 microversion: 2.1 time: 0.034570 Oct 04 12:11:00.393660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 519/776] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:11:00 2022] GET /compute/v2.1/servers/3e61328a-974d-4929-a32b-c273cfccc860 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:00.417499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:00.418630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:00.425740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.426226 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.426661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.427409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:00.427849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:00.428537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:00.501813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:00.510813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:00.512336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:00.513481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e6a1220f-8249-4b08-bf66-339cc39b89a1 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1334 microversion: 2.20 time: 0.100241 Oct 04 12:11:00.514043 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 520/777] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:00 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:11:01.543582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:01.544293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:01.551652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.552289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.553055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.553590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.554273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.555044 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.626328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:01.635592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:01.637125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:01.638262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cfa8a932-da58-4c23-a009-1e794f3384bc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1352 microversion: 2.20 time: 0.099393 Oct 04 12:11:01.638828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 521/778] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:01 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:01.855066 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:01.855593 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:01.862014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.866858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.866858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.866858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.866858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.867541 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.879585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 HTTP/1.1 Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:01.881321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.887609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'f0314f45-1648-422f-9456-e64956b6ad32'} Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:01.888612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.890336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.891871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:01.891871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1593377b-178e-4270-a8dd-3fa4dd0e788a tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 404 len: 111 microversion: 2.1 time: 0.031858 Oct 04 12:11:01.891871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 522/779] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:11:01 2022] DELETE /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:01.895867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:01.896966 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: f0314f45-1648-422f-9456-e64956b6ad32] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:01.909405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.910240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.911017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.913466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.914254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.914993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.939172 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 HTTP/1.1 Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:01.944983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.946928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'f0314f45-1648-422f-9456-e64956b6ad32'} Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:01.948589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. Oct 04 12:11:01.951380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.954153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance f0314f45-1648-422f-9456-e64956b6ad32 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:01.954153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-72b0363f-7b5d-4ca5-8ae7-7dd7e2db25b1 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32" status: 404 len: 111 microversion: 2.1 time: 0.054309 Oct 04 12:11:01.954153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 523/780] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:11:01 2022] GET /compute/v2.1/servers/f0314f45-1648-422f-9456-e64956b6ad32 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:11:01.957443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:01.958173 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:01.966464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.966961 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.967392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.968115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:01.968609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:01.969070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:01.985015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff HTTP/1.1 Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:01.986660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:01.992050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'bbd8bd8a-3940-41fa-9d04-8d64e5932dff'} Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:01.993081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:01.994597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:01.996202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:01.996202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-19a0dc0a-d815-4ca7-ab3b-7e7a6ca160c5 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 404 len: 111 microversion: 2.1 time: 0.038208 Oct 04 12:11:01.996202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 524/781] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:11:01 2022] DELETE /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:11:01.999389 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:01.999964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: bbd8bd8a-3940-41fa-9d04-8d64e5932dff] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:02.008524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:02.009499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:02.010029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:02.011078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:02.011741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:02.012426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:02.039541 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff HTTP/1.1 Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:02.043568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:02.045316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'bbd8bd8a-3940-41fa-9d04-8d64e5932dff'} Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:02.046120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. Oct 04 12:11:02.047386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:02.049368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance bbd8bd8a-3940-41fa-9d04-8d64e5932dff could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:02.049368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-60955a26-9a8c-429a-9109-8ca925fe82f7 tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff" status: 404 len: 111 microversion: 2.1 time: 0.052749 Oct 04 12:11:02.049368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 525/782] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:11:01 2022] GET /compute/v2.1/servers/bbd8bd8a-3940-41fa-9d04-8d64e5932dff => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:02.666494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:02.668126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:02.679803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:02.681108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:02.681879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:02.683264 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:02.684857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:02.685675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:02.967870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:02.981671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:02.985413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:02.987184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-92f7bddc-5700-4ff9-b93a-f7675affd024 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.326402 Oct 04 12:11:02.988413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 526/783] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:02 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:04.032005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:04.033841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:04.043349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:04.043999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:04.044770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:04.045557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:04.046040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:04.046604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:04.254212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:04.265483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:04.267916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:04.269900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-068472e3-b417-4e1a-b1af-2aa30ba6f48a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.243111 Oct 04 12:11:04.270705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 527/784] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:04 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:04.275756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-127e0f03-2961-471d-be37-3730a0b27355 req-3cf1a64c-9d6e-41fe-9e7f-f96cd97f1360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eede383-c39e-47b4-8bc0-0aae982633bc", "tag": "5746ed9b-3dfc-4c16-9d49-5849d2aeefda"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:04.286893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-127e0f03-2961-471d-be37-3730a0b27355 req-3cf1a64c-9d6e-41fe-9e7f-f96cd97f1360 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:04.293459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-127e0f03-2961-471d-be37-3730a0b27355 req-3cf1a64c-9d6e-41fe-9e7f-f96cd97f1360 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:04.293459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-127e0f03-2961-471d-be37-3730a0b27355 req-3cf1a64c-9d6e-41fe-9e7f-f96cd97f1360 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:04.300235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-127e0f03-2961-471d-be37-3730a0b27355 req-3cf1a64c-9d6e-41fe-9e7f-f96cd97f1360 service nova] Creating event network-changed:5746ed9b-3dfc-4c16-9d49-5849d2aeefda for instance 8eede383-c39e-47b4-8bc0-0aae982633bc on hv-cinder-86021 Oct 04 12:11:04.305514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-127e0f03-2961-471d-be37-3730a0b27355 req-3cf1a64c-9d6e-41fe-9e7f-f96cd97f1360 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033588 Oct 04 12:11:04.306170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 528/785] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:04.606159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:04.606758 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:04.610019 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:04.614319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:04.619647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:04.619647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:04.619647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:04.619647 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:04.620412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:04.632923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b HTTP/1.1 Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:04.634660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.637208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b'} Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:04.638813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.641423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.643908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:04.643908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-73c6713a-7373-444d-9e65-1209db4dfb9c tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 404 len: 111 microversion: 2.1 time: 0.035185 Oct 04 12:11:04.643908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 529/786] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:11:04 2022] DELETE /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:04.649102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:04.649932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] [instance: fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:04.658784 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:04.659396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:04.659984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:04.660776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:04.665401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:04.665401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:04.678105 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] HTTP exception thrown: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Request method failure captured: Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b HTTP/1.1 Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCDnhlYAsQLj97kPMQf5svds_4M2OjbKg-aAiSvQIWINDRlGXUbUKIzWvuQcT0kaOxLkzBPJ4D7_E0vESxkO_0rmxIu3LiN8fIkZh-xl9TGkY6FqzpLpojkMvz5ECa_D6vLuB8_kvjIB5YgJQFWB2FliBhqNPveXQGPgXznszkckR24 Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:04.679855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f021c9955236461abc441e2a31421b8b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f021c9955236461abc441e2a31421b8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f021c9955236461abc441e2a31421b8b"}]}] Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f021c9955236461abc441e2a31421b8b Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-880244603 Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 0e8d03fe51534f8e867d0f83c3db2d36 Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeNegativeTest-880244603-project Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.682191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b'} Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:04.683677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. Oct 04 12:11:04.686361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:04.688575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] Returning 404 to user: Instance fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:04.688575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-dc7d02b9-0f7e-4b67-b01e-247e139e2aae tempest-AttachVolumeNegativeTest-880244603 tempest-AttachVolumeNegativeTest-880244603-project] 10.222.0.15 "GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b" status: 404 len: 111 microversion: 2.1 time: 0.038063 Oct 04 12:11:04.688575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 530/787] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:11:04 2022] GET /compute/v2.1/servers/fcfcc6f0-d2d6-4710-ab8d-88d2d931ce7b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:05.306051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:05.307380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:05.315437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:05.317750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:05.317750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:05.317750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:05.318224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:05.318224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:05.591623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:05.608639 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:05.611771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:05.614016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5e969fac-a84d-4658-9286-8c592b0a0ec0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.312282 Oct 04 12:11:05.615081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 531/788] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:05 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:06.653365 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:06.654494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:06.662886 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:06.663640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:06.664204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:06.665180 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:06.665820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:06.666379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:06.890984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:07.072320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:07.083779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:07.086268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:07.087827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7ef1f99c-b806-4300-be38-68652a117e4c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.439746 Oct 04 12:11:07.088742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 532/789] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:06 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:08.123562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:08.124848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:08.139032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:08.139032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:08.139465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:08.141612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:08.142751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:08.143776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:08.268237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=14 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:08.471555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:08.484661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:08.487343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:08.489419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3a7aaa83-183f-464b-853a-d17149924d93 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.374504 Oct 04 12:11:08.490415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 533/790] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:08 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:11:09.546578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:09.546578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:09.579009 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:09.579852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:09.580806 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:09.582279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:09.582964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:09.583694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:09.913197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:09.933633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:09.937070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:09.939415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ef7e2cf8-1b80-439f-82a6-4f126a0af38b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.412009 Oct 04 12:11:09.940747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 534/791] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:09 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:11:10.982968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:10.984029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:10.999597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:10.999597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:10.999597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:10.999597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:11.000841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:11.000841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:11.003301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:11:11.245043 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:11.255395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:11.258298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:11.260540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-15c6b2d5-4c34-4f68-9ed5-a5b6af432661 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.281579 Oct 04 12:11:11.261548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 535/792] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:10 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:12.310289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:12.311197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:12.325480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:12.326582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:12.327997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:12.329586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:12.330660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:12.331487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:12.535057 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:12.544915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:12.546402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:12.547573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-82e8d749-dc05-4ea3-838d-403a2388b9bd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.248724 Oct 04 12:11:12.548456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 536/793] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:12 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:12.602052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-72640a85-1b47-4106-a167-0e36ea2d0e6a req-c5033991-ad0c-4d9c-9e4e-f24c1aee88d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eede383-c39e-47b4-8bc0-0aae982633bc", "name": "network-vif-plugged", "status": "completed", "tag": "5746ed9b-3dfc-4c16-9d49-5849d2aeefda"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:12.613366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-72640a85-1b47-4106-a167-0e36ea2d0e6a req-c5033991-ad0c-4d9c-9e4e-f24c1aee88d9 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:12.613850 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-72640a85-1b47-4106-a167-0e36ea2d0e6a req-c5033991-ad0c-4d9c-9e4e-f24c1aee88d9 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:12.614284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-72640a85-1b47-4106-a167-0e36ea2d0e6a req-c5033991-ad0c-4d9c-9e4e-f24c1aee88d9 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:12.629870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-72640a85-1b47-4106-a167-0e36ea2d0e6a req-c5033991-ad0c-4d9c-9e4e-f24c1aee88d9 service nova] Creating event network-vif-plugged:5746ed9b-3dfc-4c16-9d49-5849d2aeefda for instance 8eede383-c39e-47b4-8bc0-0aae982633bc on hv-cinder-86021 Oct 04 12:11:12.635108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-72640a85-1b47-4106-a167-0e36ea2d0e6a req-c5033991-ad0c-4d9c-9e4e-f24c1aee88d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037720 Oct 04 12:11:12.636081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 537/794] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:11:13.577026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:13.577889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:13.584716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:13.585302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:13.585667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:13.587218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:13.587702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:13.588198 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:13.770040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:13.780303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:13.782027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:13.784023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-185c9796-533d-4212-8a7f-332a097fb388 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.213908 Oct 04 12:11:13.785652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 538/795] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:13 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:13.973452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-88872bee-c41c-486d-9537-7c51235bd5e3 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Action: 'create', calling method: .version_select at 0x7f10c3837700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-335892724"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:15.040928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-88872bee-c41c-486d-9537-7c51235bd5e3 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.254017 Oct 04 12:11:15.041937 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 539/796] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Oct 4 12:11:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1256 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 12:11:15.051739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:15.052687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:15.064819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:15.065702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:15.066451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:15.067687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:15.068582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:15.069230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:15.301773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:15.319949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:15.324841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:15.330300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a80018e9-ca6c-478a-baa1-ced3f54d5f1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1407 microversion: 2.20 time: 0.283442 Oct 04 12:11:15.330300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 540/797] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:15 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:11:15.344346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-552fcf86-9d3f-415b-b968-b8b28d5e72f4 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3bb7b80>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:15.419712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-552fcf86-9d3f-415b-b968-b8b28d5e72f4 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc" status: 200 len: 344 microversion: 2.1 time: 0.089765 Oct 04 12:11:15.421060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 541/798] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:11:15 2022] GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc => generated 344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:16.374856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:16.387795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:16.387795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:16.387795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:16.387795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:16.388460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:16.388460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:16.388460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:16.552000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:16.562299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:16.563972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:11:16.565480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b91ee73e-2d1d-48cf-a124-12b0a33f28b7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1599 microversion: 2.20 time: 0.195896 Oct 04 12:11:16.566055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 542/799] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:11:16 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1599 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:11:16.571550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d16018d5-04bc-4575-a109-dd1031c86e2c tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c37ded30>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:16.628226 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d16018d5-04bc-4575-a109-dd1031c86e2c tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc" status: 200 len: 345 microversion: 2.1 time: 0.061064 Oct 04 12:11:16.628822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 543/800] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:11:16 2022] GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:16.634304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:16.634828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:11:16.642138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:16.643203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:16.643203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:16.643747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:16.644230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:16.644657 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:16.734265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b59a4eb5-428b-4e47-b779-00ef9298cafa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104061 Oct 04 12:11:16.735260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 544/801] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Oct 4 12:11:16 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:11:16.744155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-60087a1c-800c-4dcf-8e70-059cc5ab181e tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Action: 'create', calling method: .version_select at 0x7f10c45a10d0>, body: {"snapshot": {"volume_id": "2098c8fc-b2e2-4efc-a397-599e254850bc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-612263653"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:17.627133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-60087a1c-800c-4dcf-8e70-059cc5ab181e tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.889454 Oct 04 12:11:17.634758 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 545/802] 10.222.0.15 () {60 vars in 1162 bytes} [Tue Oct 4 12:11:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:17.648550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b290af3f-99ba-4496-ba0d-084dc68bfa99 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c38dedc0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:17.717323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b290af3f-99ba-4496-ba0d-084dc68bfa99 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 200 len: 286 microversion: 2.1 time: 0.075641 Oct 04 12:11:17.718140 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 546/803] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:17 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:17.735672 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8cf93099-9f3f-48e8-9e8b-679b676256cb tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c38379d0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:17.797593 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8cf93099-9f3f-48e8-9e8b-679b676256cb tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.068729 Oct 04 12:11:17.798949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 547/804] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Oct 4 12:11:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:17.813496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b5343021-f3a1-42df-a706-513c2aa050c9 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c37de940>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:17.853072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b5343021-f3a1-42df-a706-513c2aa050c9 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 200 len: 286 microversion: 2.1 time: 0.043499 Oct 04 12:11:17.853338 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 548/805] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:17 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:11:18.546141 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-713423cf-d2c9-44b7-9559-01d5400d08e8 req-c3e5b0cf-e9df-461a-b990-22e1a7e1d811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eede383-c39e-47b4-8bc0-0aae982633bc", "tag": "5746ed9b-3dfc-4c16-9d49-5849d2aeefda"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:11:18.559018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-713423cf-d2c9-44b7-9559-01d5400d08e8 req-c3e5b0cf-e9df-461a-b990-22e1a7e1d811 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:11:18.559590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-713423cf-d2c9-44b7-9559-01d5400d08e8 req-c3e5b0cf-e9df-461a-b990-22e1a7e1d811 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:11:18.560085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-713423cf-d2c9-44b7-9559-01d5400d08e8 req-c3e5b0cf-e9df-461a-b990-22e1a7e1d811 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:11:18.572036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-713423cf-d2c9-44b7-9559-01d5400d08e8 req-c3e5b0cf-e9df-461a-b990-22e1a7e1d811 service nova] Creating event network-changed:5746ed9b-3dfc-4c16-9d49-5849d2aeefda for instance 8eede383-c39e-47b4-8bc0-0aae982633bc on hv-cinder-86021 Oct 04 12:11:18.580496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-713423cf-d2c9-44b7-9559-01d5400d08e8 req-c3e5b0cf-e9df-461a-b990-22e1a7e1d811 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040274 Oct 04 12:11:18.580496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 549/806] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:11:18.874567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-224a1e43-517e-463a-bf6e-55e991466b2f tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c38deca0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:18.944573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-224a1e43-517e-463a-bf6e-55e991466b2f tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 200 len: 286 microversion: 2.1 time: 0.078593 Oct 04 12:11:18.954831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 550/807] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:18 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:19.971334 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-22944411-f7f7-4e2f-a59f-d28420cebda0 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c37dea60>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:20.030378 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-22944411-f7f7-4e2f-a59f-d28420cebda0 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 200 len: 286 microversion: 2.1 time: 0.069918 Oct 04 12:11:20.032622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 551/808] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:19 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:21.046023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6f45242d-dd7c-4b44-a590-526895abbae2 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3947820>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:21.083046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6f45242d-dd7c-4b44-a590-526895abbae2 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 200 len: 286 microversion: 2.1 time: 0.041890 Oct 04 12:11:21.083545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 552/809] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:21 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:11:22.105424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-07280e43-6fa7-434c-9357-fecd3ba7f4bc tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3770ca0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:22.153234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-07280e43-6fa7-434c-9357-fecd3ba7f4bc tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 200 len: 287 microversion: 2.1 time: 0.056796 Oct 04 12:11:22.154408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 553/810] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:22 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:22.175325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-316c9233-11a3-4b84-9a87-4988fb1e864e tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c38de790>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:22.474269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-316c9233-11a3-4b84-9a87-4988fb1e864e tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 202 len: 0 microversion: 2.1 time: 0.307333 Oct 04 12:11:22.474853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 554/811] 10.222.0.15 () {58 vars in 1254 bytes} [Tue Oct 4 12:11:22 2022] DELETE /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:11:22.484569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-41b53107-4d1b-49e7-9a68-2e728bf664be tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3b89b80>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:22.524444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-41b53107-4d1b-49e7-9a68-2e728bf664be tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 200 len: 286 microversion: 2.1 time: 0.044635 Oct 04 12:11:22.525041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 555/812] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:22 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:11:23.539841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-444d3e73-4d45-427a-81be-8188549313bd tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3972dc0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:23.567286 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-444d3e73-4d45-427a-81be-8188549313bd tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] HTTP exception thrown: Snapshot a4b9ef4c-2195-47e9-8300-7125b1a2640e could not be found. Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-444d3e73-4d45-427a-81be-8188549313bd tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Request method failure captured: Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e HTTP/1.1 Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLhcM_KqLyw5bc1RZEljLogSyz0i7yD7wTsJhhbvxCe-2pGBWRUIuA5epMMNQaIbKvcChCLx0gs3E213jgoNEGz8Bjkp7FIY4vWQDyCeppfugzwXpUEWGi7YOJVgzi1vfMUsL-S4hoVxBsiq4pzocgCtmEBYDc-3anyJMYHfdIYdis Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:23.571098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_63435c4e170a4cd19a39997da716d345", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}] Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fa19a37a4ae84e1487963e1dea311eb7 Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Snapshot a4b9ef4c-2195-47e9-8300-7125b1a2640e could not be found. Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'a4b9ef4c-2195-47e9-8300-7125b1a2640e'} Oct 04 12:11:23.572687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a4b9ef4c-2195-47e9-8300-7125b1a2640e could not be found. (HTTP 404) (Request-ID: req-13cb20f0-5038-4530-a409-1a7482ebe0e4) Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:23.574125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:11:23.575590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a4b9ef4c-2195-47e9-8300-7125b1a2640e could not be found. Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 12:11:23.576851 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a4b9ef4c-2195-47e9-8300-7125b1a2640e could not be found. Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a4b9ef4c-2195-47e9-8300-7125b1a2640e could not be found. Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-444d3e73-4d45-427a-81be-8188549313bd tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Returning 404 to user: Snapshot a4b9ef4c-2195-47e9-8300-7125b1a2640e could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-444d3e73-4d45-427a-81be-8188549313bd tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e" status: 404 len: 111 microversion: 2.1 time: 0.039314 Oct 04 12:11:23.579245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 556/813] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Oct 4 12:11:23 2022] GET /compute/v2.1/os-snapshots/a4b9ef4c-2195-47e9-8300-7125b1a2640e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:23.589945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-999988a3-d261-4276-90f2-284939250049 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3837670>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:23.929137 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-999988a3-d261-4276-90f2-284939250049 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc" status: 202 len: 0 microversion: 2.1 time: 0.345376 Oct 04 12:11:23.930655 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 557/814] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:11:23 2022] DELETE /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:11:23.951702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6b9c881b-0d17-4f7f-8d79-b95bcae45f12 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3837b80>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:24.018704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6b9c881b-0d17-4f7f-8d79-b95bcae45f12 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc" status: 200 len: 344 microversion: 2.1 time: 0.076555 Oct 04 12:11:24.019251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 558/815] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:11:23 2022] GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:11:25.034643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7e4c7cca-d005-4ca2-bbc8-ad9b25bcea57 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3972670>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:25.067054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-7e4c7cca-d005-4ca2-bbc8-ad9b25bcea57 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] HTTP exception thrown: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7e4c7cca-d005-4ca2-bbc8-ad9b25bcea57 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Request method failure captured: Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc HTTP/1.1 Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLhcM_KqLyw5bc1RZEljLogSyz0i7yD7wTsJhhbvxCe-2pGBWRUIuA5epMMNQaIbKvcChCLx0gs3E213jgoNEGz8Bjkp7FIY4vWQDyCeppfugzwXpUEWGi7YOJVgzi1vfMUsL-S4hoVxBsiq4pzocgCtmEBYDc-3anyJMYHfdIYdis Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:25.071852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_63435c4e170a4cd19a39997da716d345", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}] Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fa19a37a4ae84e1487963e1dea311eb7 Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '2098c8fc-b2e2-4efc-a397-599e254850bc'} Oct 04 12:11:25.074519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. (HTTP 404) (Request-ID: req-189c1423-8d47-4a94-83e4-16846535930d) Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.075710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:11:25.077700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 12:11:25.079210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7e4c7cca-d005-4ca2-bbc8-ad9b25bcea57 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Returning 404 to user: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7e4c7cca-d005-4ca2-bbc8-ad9b25bcea57 tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc" status: 404 len: 109 microversion: 2.1 time: 0.044626 Oct 04 12:11:25.080785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 559/816] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:11:25 2022] GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:11:25.098850 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9cfe8f13-090d-440d-91c6-b0119e87e2db tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c3693280>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:25.137078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-9cfe8f13-090d-440d-91c6-b0119e87e2db tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] HTTP exception thrown: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9cfe8f13-090d-440d-91c6-b0119e87e2db tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Request method failure captured: Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc HTTP/1.1 Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLhcM_KqLyw5bc1RZEljLogSyz0i7yD7wTsJhhbvxCe-2pGBWRUIuA5epMMNQaIbKvcChCLx0gs3E213jgoNEGz8Bjkp7FIY4vWQDyCeppfugzwXpUEWGi7YOJVgzi1vfMUsL-S4hoVxBsiq4pzocgCtmEBYDc-3anyJMYHfdIYdis Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:25.139313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_63435c4e170a4cd19a39997da716d345", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}] Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fa19a37a4ae84e1487963e1dea311eb7 Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '2098c8fc-b2e2-4efc-a397-599e254850bc'} Oct 04 12:11:25.142347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. (HTTP 404) (Request-ID: req-9c3d8d3a-56f7-4b2a-9e70-0d33b0b45d7a) Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.144108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 12:11:25.155718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 12:11:25.158361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9cfe8f13-090d-440d-91c6-b0119e87e2db tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Returning 404 to user: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9cfe8f13-090d-440d-91c6-b0119e87e2db tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc" status: 404 len: 109 microversion: 2.1 time: 0.050748 Oct 04 12:11:25.161414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 560/817] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:11:25 2022] DELETE /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:11:25.163572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-136397ac-2c9a-45ac-a650-544fd2c8814d tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Calling method '.version_select at 0x7f10c38374c0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:11:25.183157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-136397ac-2c9a-45ac-a650-544fd2c8814d tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] HTTP exception thrown: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-136397ac-2c9a-45ac-a650-544fd2c8814d tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Request method failure captured: Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc HTTP/1.1 Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLhcM_KqLyw5bc1RZEljLogSyz0i7yD7wTsJhhbvxCe-2pGBWRUIuA5epMMNQaIbKvcChCLx0gs3E213jgoNEGz8Bjkp7FIY4vWQDyCeppfugzwXpUEWGi7YOJVgzi1vfMUsL-S4hoVxBsiq4pzocgCtmEBYDc-3anyJMYHfdIYdis Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:11:25.185540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_63435c4e170a4cd19a39997da716d345", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/63435c4e170a4cd19a39997da716d345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/63435c4e170a4cd19a39997da716d345"}]}] Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 63435c4e170a4cd19a39997da716d345 Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-868865439 Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: fa19a37a4ae84e1487963e1dea311eb7 Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesSnapshotsTestJSON-868865439-project Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '2098c8fc-b2e2-4efc-a397-599e254850bc'} Oct 04 12:11:25.187761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. (HTTP 404) (Request-ID: req-c344c699-b5ce-4d57-9c2c-61d469440d00) Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.190517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:11:25.191869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 12:11:25.194136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-136397ac-2c9a-45ac-a650-544fd2c8814d tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] Returning 404 to user: Volume 2098c8fc-b2e2-4efc-a397-599e254850bc could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-136397ac-2c9a-45ac-a650-544fd2c8814d tempest-VolumesSnapshotsTestJSON-868865439 tempest-VolumesSnapshotsTestJSON-868865439-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc" status: 404 len: 109 microversion: 2.1 time: 0.040033 Oct 04 12:11:25.196412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 561/818] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:11:25 2022] GET /compute/v2.1/os-volumes/2098c8fc-b2e2-4efc-a397-599e254850bc => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:12:05.814795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=26 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:05.815901 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=37 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:05.820094 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:05.820740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:05.828038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:05.828559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:05.828992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:05.829730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:05.830183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:05.830609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:05.858004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fc43e958-30bc-4960-b72f-b000aa35383b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/ips" status: 200 len: 152 microversion: 2.20 time: 0.045604 Oct 04 12:12:05.860383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 562/819] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Oct 4 12:12:05 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:12:10.510254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:10.511061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:10.518583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:10.519083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:10.519533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:10.520313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:10.521203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:10.523207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:10.552819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lazy-loading 'flavor' on Instance uuid 8eede383-c39e-47b4-8bc0-0aae982633bc {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:12:11.205679 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8cc0cfbf-37c7-4145-b98b-69c0a4d6b045 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/action" status: 202 len: 0 microversion: 2.20 time: 0.699059 Oct 04 12:12:11.206852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 563/820] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 4 12:12:10 2022] POST /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:12:11.217036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:11.217722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:11.224893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:11.225390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:11.225836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:11.226566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:11.227029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:11.227459 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:11.394886 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:11.404807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:11.406267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:11.407560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4508ccf9-b08f-4ccf-8b0c-92f4c688fba0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.195136 Oct 04 12:12:11.408240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 564/821] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:11 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:12.437168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:12.448635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:12.448635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:12.448635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:12.448635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:12.449151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:12.449151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:12.449151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:12.614588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:12.632080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:12.636990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:12.637576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d6114c7c-6f2a-42ed-8df8-602da5f46c70 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.204157 Oct 04 12:12:12.638337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 565/822] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:12 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:12.718887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-569025055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-25342910", "security_groups": [{"name": "tempest-secgroup-smoke-1755792237"}], "block_device_mapping_v2": [{"uuid": "f2e9e828-fb5e-491c-9f61-2620d44f5aa8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5762fef7-720d-4252-ae68-656d8eb02e71"}]}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:12.930078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] validate_networks() for [('5762fef7-720d-4252-ae68-656d8eb02e71', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:12:13.884795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:12:13.885433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:12:13.885796 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:12:13.886207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:12:13.886624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:12:13.898420 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:13.899616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:13.900136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:13.901282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:13.902014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:13.902747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:13.927542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for project d4da0e2bff704d7a944445d0011a8667. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:12:13.932392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Getting quotas for user 76771369a0df4c5189e42291ebdf9d24 and project d4da0e2bff704d7a944445d0011a8667. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:12:13.998832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:12:14.001176 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f2e9e828-fb5e-491c-9f61-2620d44f5aa8',volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:12:14.777587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-da3e48d0-d119-4d71-9e04-b8d80d23b8a5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.059197 Oct 04 12:12:14.777587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 566/823] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:12:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:12:14.780882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:14.782079 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:14.794165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:14.794900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:14.795659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:14.796660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:14.797764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:14.798428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:14.963905 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:14.978511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:14.978511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:14.978511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e5b02a3e-4eb3-4fca-8da6-163fb5df26da tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.204598 Oct 04 12:12:14.978935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 567/824] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:14 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:14.984698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d01f0a6f-16f1-478c-b7cd-3b88cd5ad356 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:14.985580 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d01f0a6f-16f1-478c-b7cd-3b88cd5ad356 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:15.054684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d01f0a6f-16f1-478c-b7cd-3b88cd5ad356 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:15.062520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d01f0a6f-16f1-478c-b7cd-3b88cd5ad356 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1092 microversion: 2.1 time: 0.082298 Oct 04 12:12:15.064548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 568/825] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:14 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1092 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:16.021312 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:16.022042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:16.030085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:16.030683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:16.031140 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:16.031870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:16.032389 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:16.032824 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:16.309312 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:16.320668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:16.323363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:16.326550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-dd9372d5-a81b-4b7e-8b86-3963c4f653fa tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.308975 Oct 04 12:12:16.329072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 569/826] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:16 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:16.335826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-309cb646-1892-40a9-887f-28bd0a4f79fd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:16.337273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-309cb646-1892-40a9-887f-28bd0a4f79fd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:16.408273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-309cb646-1892-40a9-887f-28bd0a4f79fd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:16.417591 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-309cb646-1892-40a9-887f-28bd0a4f79fd tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1092 microversion: 2.1 time: 0.086425 Oct 04 12:12:16.418471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 570/827] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:16 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1092 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:17.352789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:17.353458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:17.360927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:17.361422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:17.361870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:17.362625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:17.363081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:17.363509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:17.552428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:17.572844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:17.575663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:17.578163 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d0de442e-2e91-4dbe-ace0-6cad2387ede2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.229141 Oct 04 12:12:17.579067 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 571/828] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:17 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:17.592072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-223969b3-7e95-4b09-b610-54c34da46637 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:17.592072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-223969b3-7e95-4b09-b610-54c34da46637 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:17.657386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-223969b3-7e95-4b09-b610-54c34da46637 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:17.665005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-223969b3-7e95-4b09-b610-54c34da46637 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1092 microversion: 2.1 time: 0.084624 Oct 04 12:12:17.665737 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 572/829] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:17 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1092 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:18.608134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:18.608911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:18.620051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:18.620745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:18.621471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:18.622311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:18.622924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:18.623514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:18.845385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:18.870315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:18.874435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:18.877900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-423db19b-99e8-4e99-90c6-887ea2684159 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.275121 Oct 04 12:12:18.879352 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 573/830] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:18 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:18.888613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-43ba46ca-ca70-4aec-9025-17778ca1b2e6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:18.890395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-43ba46ca-ca70-4aec-9025-17778ca1b2e6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:18.962964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-43ba46ca-ca70-4aec-9025-17778ca1b2e6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:18.970559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-43ba46ca-ca70-4aec-9025-17778ca1b2e6 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1092 microversion: 2.1 time: 0.089518 Oct 04 12:12:18.971149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 574/831] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:18 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1092 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:19.909743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:19.911097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:19.924938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:19.925798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:19.926565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:19.927838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:19.928913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:19.929783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:20.135801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:20.153423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:20.155673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:20.157792 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5aa2d356-a65a-421a-afb5-90c2791639a4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.255474 Oct 04 12:12:20.168822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 575/832] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:19 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:20.168822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:20.168822 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:20.173575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:20.174081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:20.174534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:20.175275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:20.175779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:20.176243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:20.263223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:20.281228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d2526064-2f5f-4958-b398-59c9d1375c6c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1142 microversion: 2.1 time: 0.119989 Oct 04 12:12:20.282237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 576/833] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:20 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1142 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:21.190386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:21.191275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:21.204383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:21.205181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:21.206033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:21.207174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:21.207958 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:21.208903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:21.418481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:21.433469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:21.436205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:21.438506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c2c4513d-18b4-4526-8602-8b732f895f45 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.256876 Oct 04 12:12:21.439708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 577/834] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:21 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:21.447374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:21.448470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:21.458823 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:21.460320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:21.461854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:21.463340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:21.464065 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:21.464984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:21.557017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:21.567252 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1f0753b1-e2ce-4a56-a88e-7a661899b58f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1190 microversion: 2.1 time: 0.125987 Oct 04 12:12:21.568038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 578/835] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:21 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1190 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:22.472753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:22.474082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:22.501145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:22.502714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:22.503528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:22.505097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:22.506110 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:22.506806 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:22.863531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:22.878908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:22.884112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:22.886877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f2ea1327-142d-4ebd-a372-80bf9b82d17c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1745 microversion: 2.20 time: 0.418798 Oct 04 12:12:22.888576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 579/836] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:22 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1745 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:22.899429 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:22.901819 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:22.912000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:22.912883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:22.913258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:22.914035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:22.918304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:22.918304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:22.990480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:23.000095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-667a3ffe-7181-4abc-8d2a-35eeb644d6d7 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1208 microversion: 2.1 time: 0.109831 Oct 04 12:12:23.000988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 580/837] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:22 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1208 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:23.915640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:23.916408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:23.919069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:23.924353 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:23.924847 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:23.925286 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:23.926002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:23.926582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:23.927008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:23.952145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:24.309345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:24.319450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:24.321615 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:24.323719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-15911713-89b7-4c69-94dc-afac2ae480a2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1745 microversion: 2.20 time: 0.412207 Oct 04 12:12:24.324386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 581/838] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:23 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1745 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:24.346930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:24.349319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:24.361564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:24.362311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:24.362480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:24.363207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:24.363669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:24.364093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:24.675024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:24.690250 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-27f2a75b-cbc5-4a52-8d75-b1705dda930c tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1276 microversion: 2.1 time: 0.364255 Oct 04 12:12:24.691061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 582/839] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:24 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1276 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:24.831004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-7c92c377-d94e-4408-89df-8e7c92d9e968 req-0b59ab07-0fb7-44bc-8491-651b398f4913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eede383-c39e-47b4-8bc0-0aae982633bc", "name": "network-vif-plugged", "status": "completed", "tag": "5746ed9b-3dfc-4c16-9d49-5849d2aeefda"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:24.847145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7c92c377-d94e-4408-89df-8e7c92d9e968 req-0b59ab07-0fb7-44bc-8491-651b398f4913 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:24.847712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7c92c377-d94e-4408-89df-8e7c92d9e968 req-0b59ab07-0fb7-44bc-8491-651b398f4913 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:24.848391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-7c92c377-d94e-4408-89df-8e7c92d9e968 req-0b59ab07-0fb7-44bc-8491-651b398f4913 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:24.874306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-7c92c377-d94e-4408-89df-8e7c92d9e968 req-0b59ab07-0fb7-44bc-8491-651b398f4913 service nova] Creating event network-vif-plugged:5746ed9b-3dfc-4c16-9d49-5849d2aeefda for instance 8eede383-c39e-47b4-8bc0-0aae982633bc on hv-cinder-86021 Oct 04 12:12:24.882158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-7c92c377-d94e-4408-89df-8e7c92d9e968 req-0b59ab07-0fb7-44bc-8491-651b398f4913 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053201 Oct 04 12:12:24.883349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 583/840] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:12:25.368106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:25.368965 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:25.379885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:25.380494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:25.380943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:25.382003 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:25.383174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:25.383669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:25.554201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:25.562861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:25.564326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:25.565494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4e326ba4-0789-4bbc-88a2-c88380d05e88 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.205751 Oct 04 12:12:25.566085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 584/841] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:25 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:25.627885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-d4163347-ee25-43e4-9c2b-a1234989ba47 req-33e0914e-50ac-40da-972a-e6b1a9a7c1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa30ac5-5c3d-4440-be77-ec7f7ba22389", "tag": "faca2777-bf01-421f-9263-4a3fd0fb6283"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:25.639422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d4163347-ee25-43e4-9c2b-a1234989ba47 req-33e0914e-50ac-40da-972a-e6b1a9a7c1d5 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:25.640026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d4163347-ee25-43e4-9c2b-a1234989ba47 req-33e0914e-50ac-40da-972a-e6b1a9a7c1d5 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:25.640675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d4163347-ee25-43e4-9c2b-a1234989ba47 req-33e0914e-50ac-40da-972a-e6b1a9a7c1d5 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:25.653921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-d4163347-ee25-43e4-9c2b-a1234989ba47 req-33e0914e-50ac-40da-972a-e6b1a9a7c1d5 service nova] Creating event network-changed:faca2777-bf01-421f-9263-4a3fd0fb6283 for instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 on hv-cinder-86021 Oct 04 12:12:25.659384 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-d4163347-ee25-43e4-9c2b-a1234989ba47 req-33e0914e-50ac-40da-972a-e6b1a9a7c1d5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035528 Oct 04 12:12:25.660005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 585/842] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:12:25.728739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:25.729652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:25.749750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:25.750297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:25.752155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:25.753346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:25.753828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:25.754264 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:26.045171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:26.056777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-59c01d1f-4244-4b28-9f01-db1b6b68ed06 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.332997 Oct 04 12:12:26.061109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 586/843] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:25 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:26.605828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:26.611916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:26.633433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:26.640108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:26.640880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:26.641990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:26.642615 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:26.643232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:26.929813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:26.982839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:26.984588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:26.986000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0f896ae8-5d68-42c7-ab2b-5d3db4753fa9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.395635 Oct 04 12:12:27.003603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 587/844] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:26 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:27.091738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:27.092511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:27.100096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:27.100694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:27.101417 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:27.102520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:27.103240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:27.103990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:27.317603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:27.332709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-384ba092-8a71-4888-812e-180818bb210f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.247305 Oct 04 12:12:27.352349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 588/845] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:27 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:28.027233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:28.028103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:28.039631 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:28.040248 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:28.040875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:28.042403 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:28.043069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:28.043500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:28.317641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:28.327691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:28.330016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:28.331473 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0404ffc1-e8b3-4b26-8764-8d1bb779a0a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.309279 Oct 04 12:12:28.332031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 589/846] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:28 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:28.367156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:28.368120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:28.381723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:28.383863 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:28.384956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:28.386178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:28.386719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:28.387211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:28.590670 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:28.604751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a8c3d668-c8ef-4a96-9f69-f6065a25451d tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.247076 Oct 04 12:12:28.621269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 590/847] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:28 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:29.370694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:29.371799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:29.373441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=14 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:29.379760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:29.380300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:29.380842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:29.381448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:29.381906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:29.382331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:29.613474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:29.642549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:29.645815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:29.650015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b732f50a-5d29-4cd5-a17c-bedf65b24a5b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.283774 Oct 04 12:12:29.651908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 591/848] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:29 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:29.661306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:29.662772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:29.677089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:29.678117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:29.680102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:29.682279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:29.683253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:29.684149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:29.953072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:29.976723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2387867c-acae-440d-a9e8-728cbcfa6bd3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.322491 Oct 04 12:12:29.979075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 592/849] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:29 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:30.686749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:30.689090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:30.704069 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:30.705260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:30.706711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:30.708597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:30.709656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:30.710768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:30.963125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:30.976911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:30.979046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:30.980811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-89389c48-03fd-42cd-84a6-bd2180e20d92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.305970 Oct 04 12:12:30.996230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 593/850] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:30 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:31.010750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:31.011658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:31.020396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:31.020889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:31.021341 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:31.022074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:31.022539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:31.023023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:31.248268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:31.259300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-53323c20-eb77-426c-836e-1abb203b1283 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.256912 Oct 04 12:12:31.260009 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 594/851] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:31 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:32.014756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:32.021226 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:32.033020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:32.034419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:32.035511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:32.037016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:32.038089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:32.039842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:32.855916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:32.874665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:32.879775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:32.883048 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e8b60927-6037-4feb-a3ea-d758498fd65e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.877173 Oct 04 12:12:32.900714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 595/852] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:32 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:32.900714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:32.900714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:32.902924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:32.903609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:32.904600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:32.906011 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:32.906571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:32.907208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:33.224950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:33.224950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-aa3435cb-27b5-4c24-8b8e-10f8ebe36975 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.252411 Oct 04 12:12:33.224950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 596/853] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:32 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:33.940004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:33.943527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:33.953181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:33.953890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:33.954493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:33.955368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:33.956041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:33.956508 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:34.196016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:34.221391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:34.224847 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:34.227722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-dff958d0-d545-4d44-8ffe-0291901fec37 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.299816 Oct 04 12:12:34.257035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 597/854] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:33 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:34.283644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:34.285229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:34.297790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:34.299036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:34.300054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:34.301923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:34.303058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:34.304125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:34.596765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:34.608904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-23dcc8a9-05ae-4459-92d5-a9e86c4f2018 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.349907 Oct 04 12:12:34.610084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 598/855] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:34 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:35.291561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:35.293883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:35.304945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:35.326463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:35.328040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:35.329344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:35.330666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:35.331287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:35.331976 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:35.381776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:35.680504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:35.720811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:35.730008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:35.739434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ab016b42-6a31-48ea-8659-9f0cec92ef01 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.447666 Oct 04 12:12:35.739434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 599/856] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:35 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:35.772910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:35.774672 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:35.787805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:35.789060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:35.790068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:35.792628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:35.793992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:35.794981 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:36.049913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:36.063529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-339a8a8e-ab57-4488-9921-1a5d4835306f tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.303254 Oct 04 12:12:36.064299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 600/857] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:35 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:36.811578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:36.813824 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:36.827052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:36.838288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:36.838288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:36.838288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:36.838288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:36.839063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:37.049859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:37.061010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:37.062563 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:37.063744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d24f15da-ea0a-42ad-8f67-acbc2f559fa7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.260681 Oct 04 12:12:37.068950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 601/858] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:36 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:37.077455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-458622df-fbc3-4226-8c9a-53bb3453987f req-e3bedd8a-9863-4471-80b2-0c3ef7888e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa30ac5-5c3d-4440-be77-ec7f7ba22389", "name": "network-vif-plugged", "status": "completed", "tag": "faca2777-bf01-421f-9263-4a3fd0fb6283"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:37.092371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-458622df-fbc3-4226-8c9a-53bb3453987f req-e3bedd8a-9863-4471-80b2-0c3ef7888e68 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:37.093155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-458622df-fbc3-4226-8c9a-53bb3453987f req-e3bedd8a-9863-4471-80b2-0c3ef7888e68 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:37.093766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-458622df-fbc3-4226-8c9a-53bb3453987f req-e3bedd8a-9863-4471-80b2-0c3ef7888e68 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:37.181457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-458622df-fbc3-4226-8c9a-53bb3453987f req-e3bedd8a-9863-4471-80b2-0c3ef7888e68 service nova] Creating event network-vif-plugged:faca2777-bf01-421f-9263-4a3fd0fb6283 for instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 on hv-cinder-86021 Oct 04 12:12:37.194760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-458622df-fbc3-4226-8c9a-53bb3453987f req-e3bedd8a-9863-4471-80b2-0c3ef7888e68 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122051 Oct 04 12:12:37.195463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 602/859] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:12:37.227899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:37.230695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:37.248368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:37.248861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:37.249298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:37.264006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:37.265446 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:37.266221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:37.582899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:37.606530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7334e934-604d-44c2-af31-81d18990f3e0 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.403311 Oct 04 12:12:37.620227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 603/860] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:37 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:38.091836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:38.094787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:38.111807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:38.119936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:38.119936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:38.119936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:38.124028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:38.125175 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:38.347584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:38.357699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:38.359590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:38.361267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a9eb1160-898c-4954-9796-cc1505146bd4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.274742 Oct 04 12:12:38.362426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 604/861] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:38 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:38.638583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:38.640244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:38.653408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:38.654983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:38.656096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:38.657440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:38.658272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:38.659439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:38.912802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:38.923754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-290a89fe-89e2-431f-be8b-f57770b46058 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1264 microversion: 2.1 time: 0.294096 Oct 04 12:12:38.924495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 605/862] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:38 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:39.413508 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:39.413508 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:39.416030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:39.416830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:39.417264 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:39.418675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:39.419202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:39.419777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:39.632780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:39.643456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:39.647276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:39.647276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6846e678-64db-4b74-b77c-a2708d47aa34 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1740 microversion: 2.20 time: 0.243408 Oct 04 12:12:39.648356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 606/863] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:39 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:39.954362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:39.955265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:39.963156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:39.963838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:39.964533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:39.965581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:39.966048 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:39.966483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:40.500349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:40.514713 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-63f89d22-c4c5-4194-9be1-aa606acf6f93 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1450 microversion: 2.1 time: 0.569567 Oct 04 12:12:40.515987 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 607/864] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:39 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1450 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:12:40.539925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:40.540604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:40.551402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:40.552771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:40.553470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:40.554839 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:40.555317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:40.555875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:40.852345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:40.858110 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0ee114ae-56f9-40da-89cc-1f53ced42a73 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1450 microversion: 2.1 time: 0.323001 Oct 04 12:12:40.858763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 608/865] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:40 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1450 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:12:40.863984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:40.864841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:40.871566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:40.872422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:40.873046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:40.873967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:40.874589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:40.875176 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:41.153046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:41.173617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:41.187601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:41.190369 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f9dd0160-c371-48e1-8773-e3219e2941a6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1722 microversion: 2.20 time: 0.330095 Oct 04 12:12:41.191675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 609/866] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:40 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:42.227733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:42.229988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:42.245028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:42.246150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:42.247022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:42.248608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:42.249925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:42.250667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:42.468253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:42.478541 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:42.480094 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:42.492480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-48ab8b96-f1c9-4246-ab1c-bde2d32105e3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1722 microversion: 2.20 time: 0.261229 Oct 04 12:12:42.492480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 610/867] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:42 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:42.738854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-17fdb05a-6319-49b2-9e9c-d205c10e91c6 req-2daef017-b00a-4727-a09a-4a19db67de7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eede383-c39e-47b4-8bc0-0aae982633bc", "name": "network-vif-unplugged", "status": "completed", "tag": "5746ed9b-3dfc-4c16-9d49-5849d2aeefda"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:42.750715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-17fdb05a-6319-49b2-9e9c-d205c10e91c6 req-2daef017-b00a-4727-a09a-4a19db67de7a service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:42.752223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-17fdb05a-6319-49b2-9e9c-d205c10e91c6 req-2daef017-b00a-4727-a09a-4a19db67de7a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:42.752666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-17fdb05a-6319-49b2-9e9c-d205c10e91c6 req-2daef017-b00a-4727-a09a-4a19db67de7a service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:42.766266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-17fdb05a-6319-49b2-9e9c-d205c10e91c6 req-2daef017-b00a-4727-a09a-4a19db67de7a service nova] Creating event network-vif-unplugged:5746ed9b-3dfc-4c16-9d49-5849d2aeefda for instance 8eede383-c39e-47b4-8bc0-0aae982633bc on hv-cinder-86021 Oct 04 12:12:42.772124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-17fdb05a-6319-49b2-9e9c-d205c10e91c6 req-2daef017-b00a-4727-a09a-4a19db67de7a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037084 Oct 04 12:12:42.772765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 611/868] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:12:43.513466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:43.514611 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:43.529854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:43.530697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:43.531424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:43.532739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:43.533407 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:43.534371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:43.753885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:43.763788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:43.765946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:43.767530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a8745de5-59e3-4717-96fc-540dd809ffc6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1722 microversion: 2.20 time: 0.261828 Oct 04 12:12:43.768638 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 612/869] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:43 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:43.959646 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-c79058f4-4147-47c1-a482-7d2443c2d133 req-978b8bd1-8d24-4526-aad3-474947a7d718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa30ac5-5c3d-4440-be77-ec7f7ba22389", "tag": "faca2777-bf01-421f-9263-4a3fd0fb6283"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:43.971723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-c79058f4-4147-47c1-a482-7d2443c2d133 req-978b8bd1-8d24-4526-aad3-474947a7d718 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:43.972449 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-c79058f4-4147-47c1-a482-7d2443c2d133 req-978b8bd1-8d24-4526-aad3-474947a7d718 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:43.973008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-c79058f4-4147-47c1-a482-7d2443c2d133 req-978b8bd1-8d24-4526-aad3-474947a7d718 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:43.987835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-c79058f4-4147-47c1-a482-7d2443c2d133 req-978b8bd1-8d24-4526-aad3-474947a7d718 service nova] Creating event network-changed:faca2777-bf01-421f-9263-4a3fd0fb6283 for instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 on hv-cinder-86021 Oct 04 12:12:43.996578 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-c79058f4-4147-47c1-a482-7d2443c2d133 req-978b8bd1-8d24-4526-aad3-474947a7d718 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041402 Oct 04 12:12:43.997419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 613/870] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:12:44.817798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:44.820093 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:44.828620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:44.829127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:44.829656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:44.830415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:44.831099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:44.831534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:45.138602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:45.148041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:45.149762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:45.150998 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bd840540-51d9-42a1-9ebe-d4a11edbea53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1725 microversion: 2.20 time: 0.339253 Oct 04 12:12:45.155550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 614/871] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:44 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1725 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:45.208739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bea5233f-324c-45cd-955a-52bdde042830"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:45.212354 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:45.219020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:45.219511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:45.219946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:45.220721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:45.221172 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:45.221589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:47.203212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:12:47.346723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-555a0bba-7c9c-4834-a35b-37301f4fd373 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.142609 Oct 04 12:12:47.347373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 615/872] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Oct 4 12:12:45 2022] POST /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments => generated 188 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:12:47.487152 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:47.487875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:47.495876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:47.496440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:47.496886 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:47.497631 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:47.498274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:47.498829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:47.564280 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133083) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 12:12:48.001428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-29244ed8-dbd6-4704-b0cb-f8d305a36f11 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/action" status: 202 len: 0 microversion: 2.20 time: 0.518808 Oct 04 12:12:48.002477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 616/873] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 4 12:12:47 2022] POST /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:12:48.010972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:48.011600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:48.018912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:48.019468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:48.019909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:48.020656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:48.021117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:48.021546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:48.176676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:48.188877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:48.190363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:48.191604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7a401371-6917-4947-80d6-a2dad65e346c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1751 microversion: 2.20 time: 0.184674 Oct 04 12:12:48.192183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 617/874] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:48 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:49.219777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:49.220598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:49.228610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:49.229070 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:49.229704 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:49.230410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:49.230853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:49.231267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:49.426091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:49.436855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:49.438351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:49.439723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c30a96df-c53d-4963-af4e-0ec5ff85c884 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1751 microversion: 2.20 time: 0.223883 Oct 04 12:12:49.440335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 618/875] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:49 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:50.472128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:50.475099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:50.488264 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:50.488987 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:50.489316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:50.490304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:50.491104 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:50.491719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:50.725644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:50.737842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:50.739504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:50.741893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2f0b761e-3516-45b0-bd8f-22011a66b894 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1753 microversion: 2.20 time: 0.277237 Oct 04 12:12:50.742616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 619/876] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:50 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1753 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:51.783276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:51.784315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:51.791676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:51.792307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:51.792757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:51.793545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:51.794022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:51.794448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:52.006026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:52.024153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:52.027095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:52.029275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3e1084a6-3773-444a-8bb0-ddba98b6f55c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1753 microversion: 2.20 time: 0.249863 Oct 04 12:12:52.030278 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 620/877] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:51 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:12:52.838659 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:12:52.845917 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:12:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:12:53.087744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:53.088615 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:53.097669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:53.098737 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:53.099612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:53.100671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:53.101283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:53.101777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:53.372902 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:53.385361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:53.388237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:53.390014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-29b2427b-4776-4b67-ac86-299cd9765141 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.319191 Oct 04 12:12:53.395048 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 621/878] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:53 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:54.430624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:54.431677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:54.439561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:54.440057 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:54.440592 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:54.445750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:54.445750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:54.445750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:54.671505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:54.683770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:54.686521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:54.688803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-27371f92-fdf0-48da-87f7-f3ce04ae0a3e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.262406 Oct 04 12:12:54.690090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 622/879] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:54 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:55.742444 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:55.743494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:55.759201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:55.759718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:55.760280 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:55.761058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:55.761529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:55.761984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:56.046337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:56.063703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:56.073524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:56.075294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9dfcc3f0-7acc-45c1-a04c-75a259033891 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.343950 Oct 04 12:12:56.089344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 623/880] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:55 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:56.275856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-952405910", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "networks": [{"uuid": "993e7e45-b57b-466d-b327-7943e445df81"}]}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:12:56.343121 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] validate_networks() for [('993e7e45-b57b-466d-b327-7943e445df81', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:12:56.954947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:12:56.956035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:12:56.956785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:12:56.957312 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:12:56.957909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:12:56.985038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:56.986197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:56.987228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:56.988495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:56.989202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:56.990336 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:57.014575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Getting quotas for project 23ef9812a3194dcb9c88e284be7e3982. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:12:57.019940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Getting quotas for user cf86d2ca271e4828ba8ce6cb78b2c2b4 and project 23ef9812a3194dcb9c88e284be7e3982. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:12:57.035815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:12:57.038576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:12:57.247590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1c0bc2ab-acc6-4f14-a55f-ffa3c645ac18 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976092 Oct 04 12:12:57.248667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 624/881] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:12:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 12:12:57.258693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:57.259630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:57.266773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:57.269809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:57.269809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:57.269809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:57.269809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:57.271721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:57.621499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:57.640870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:57.645061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:57.647841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-76e45f8c-9e92-40d4-972a-1909bb035c7d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.397423 Oct 04 12:12:57.649595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 625/882] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:57 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:57.665669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-070360a9-3fb0-4890-9081-da62b71fb3d4 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:57.668082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-070360a9-3fb0-4890-9081-da62b71fb3d4 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:57.811178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-070360a9-3fb0-4890-9081-da62b71fb3d4 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:57.831044 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-070360a9-3fb0-4890-9081-da62b71fb3d4 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1218 microversion: 2.1 time: 0.179490 Oct 04 12:12:57.831748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 626/883] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:57 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:58.701734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:58.703042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:58.719299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:58.719299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:58.719299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:58.719299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:58.720468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:58.720468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:58.926467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:58.945567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:58.952681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:58.954134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bdab0438-612c-455d-ab80-0e56f1d7f98f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.259778 Oct 04 12:12:58.971628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 627/884] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:58 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:12:58.979609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:58.980426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:12:58.989489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:58.991016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:58.991950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:58.993013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:12:58.993907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:12:58.994543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:12:59.093761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:12:59.110562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-18dd7fc0-0c44-461b-be35-7bb72617a436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1222 microversion: 2.1 time: 0.135249 Oct 04 12:12:59.110562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 628/885] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:12:58 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:12:59.994019 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:12:59.995079 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:00.007535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:00.008418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:00.009179 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:00.010411 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:00.011193 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:00.013018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:00.243428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:00.254208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:00.255623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:00.257432 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-62fdb545-e528-49ea-b8be-cb73ec891bae tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.274333 Oct 04 12:13:00.258032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 629/886] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:12:59 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:13:00.262779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:00.263382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:00.270391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:00.270872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:00.271301 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:00.272622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:00.273096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:00.273489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:00.359837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:00.376485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6cac209d-99cb-4d39-81c8-29ca0349369b tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1222 microversion: 2.1 time: 0.116903 Oct 04 12:13:00.392722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 630/887] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:00 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:01.289134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:01.289799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:01.296915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:01.297408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:01.297847 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:01.298563 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:01.299017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:01.299441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:01.467946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:01.480929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:01.484210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:01.486736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a522883b-8fe6-4e5f-a23c-af2ac6044157 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.201845 Oct 04 12:13:01.504418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 631/888] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:01 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:01.523328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:01.524649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:01.541961 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:01.543589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:01.544502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:01.545928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:01.547158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:01.551892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:01.624475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:01.630079 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:01.639436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-87c28b6d-ac39-49f8-b0a3-d04444a0791a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1222 microversion: 2.1 time: 0.133425 Oct 04 12:13:01.640925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 632/889] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:01 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:01.859282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-470381167", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:01.948530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] validate_networks() for None {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:13:02.421148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:13:02.422086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:13:02.422497 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:13:02.423049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:13:02.423650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:13:02.433659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:02.434134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:02.434566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:02.435284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:02.435730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:02.436185 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:02.454113 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Getting quotas for project f8feaa0c5e9349cc8e2dcc3d59120aa9. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:13:02.458446 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Getting quotas for user 1f685bdbb59f4d4b9eb68e82beedf195 and project f8feaa0c5e9349cc8e2dcc3d59120aa9. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:13:02.477892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:13:02.481455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:13:02.493680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:02.635476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0cea269d-d28e-4c80-86a3-5dd96a00822f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783758 Oct 04 12:13:02.636236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 633/890] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:13:02.641427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:02.642053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:02.650642 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:02.651144 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:02.651583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:02.652325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:02.652891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:02.653326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:02.890543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:02.901588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:02.903513 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:02.906083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e7eda4b5-d32b-4927-8b80-fc3defad877b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.267972 Oct 04 12:13:02.906083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 634/891] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:02 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:13:02.922748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-79aa1b1e-fbb4-45a9-a253-d712c651dce4 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:02.925599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-79aa1b1e-fbb4-45a9-a253-d712c651dce4 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:03.015612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-79aa1b1e-fbb4-45a9-a253-d712c651dce4 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:03.024199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-79aa1b1e-fbb4-45a9-a253-d712c651dce4 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1214 microversion: 2.1 time: 0.112557 Oct 04 12:13:03.024840 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 635/892] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:02 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:03.029782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:03.030450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:03.039677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:03.040557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:03.041397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:03.042636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:03.043423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:03.044239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:03.134660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:03.149630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fe284542-94c4-44dc-a6a8-ad538ebeab9d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1222 microversion: 2.1 time: 0.123271 Oct 04 12:13:03.150519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 636/893] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:03 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:03.932772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:03.933453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:03.940884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:03.941407 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:03.941838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:03.942553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:03.942997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:03.943491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:04.150714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:04.160235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:04.161709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:04.163504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-650ae6c7-0f14-41c3-901e-ba4512974410 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.235657 Oct 04 12:13:04.164072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 637/894] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:03 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:13:04.168780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:04.169393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:04.182118 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:04.183282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:04.184269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:04.185888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:04.186962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:04.189064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:04.273709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:04.282118 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d52989e1-ae41-41e8-81db-f25e76597385 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1218 microversion: 2.1 time: 0.116935 Oct 04 12:13:04.282728 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 638/895] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:04 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:04.288458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:04.289089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:04.296593 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:04.297251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:04.297736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:04.298523 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:04.299083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:04.299571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:04.405298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:04.415493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f20e1121-904c-4d01-a402-7753174b6469 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1222 microversion: 2.1 time: 0.131295 Oct 04 12:13:04.416442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 639/896] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:04 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:05.207571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:05.209612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:05.225820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:05.226932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:05.227756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:05.229343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:05.230948 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:05.232548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:05.476542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:05.492841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:05.494630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:05.496087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ad33b275-0f44-46b0-904f-1d81879be211 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.299519 Oct 04 12:13:05.496944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 640/897] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:05 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:05.506299 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:05.507611 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:05.520247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:05.520247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:05.525267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:05.525267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:05.525267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:05.525267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:05.621340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:05.630682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-83743899-2b47-4235-ae44-d31e143f6f85 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1218 microversion: 2.1 time: 0.132168 Oct 04 12:13:05.632077 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 641/898] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:05 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:05.646805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:05.649004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:05.662486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:05.663034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:05.663496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:05.664553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:05.665036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:05.665537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:05.758014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:05.776758 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0e15e463-dbd5-49c8-902b-35b39a55d827 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1222 microversion: 2.1 time: 0.143134 Oct 04 12:13:05.777767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 642/899] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:05 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:06.543772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:06.544514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:06.551125 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:06.551605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:06.552038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:06.553300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:06.553763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:06.554192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:06.698219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:06.708581 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:06.710191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:06.711470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5743e03b-a998-4cf0-a0ec-48274fa4a543 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.172017 Oct 04 12:13:06.712090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 643/900] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:06 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:06.716923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:06.717530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:06.723807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:06.724317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:06.725251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:06.725948 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:06.726387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:06.726803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:06.790767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:06.799783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1b30fe56-b4b2-4fe4-81ef-fd16cfca48d7 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1218 microversion: 2.1 time: 0.086315 Oct 04 12:13:06.804567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 644/901] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:06 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:06.805961 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:06.806575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:06.813049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:06.813535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:06.813965 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:06.814665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:06.815111 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:06.815527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:06.887372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:06.895572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ea84642a-a26c-430d-90bb-5050709d3e00 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1222 microversion: 2.1 time: 0.093863 Oct 04 12:13:06.896153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 645/902] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:06 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:07.738255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:07.739054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:07.746371 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:07.746993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:07.747392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:07.748101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:07.748573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:07.752223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:07.942820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:07.961856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:07.963362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:07.964768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7289981d-ed9a-49f5-af10-fb5b33f79394 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.231137 Oct 04 12:13:07.975521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 646/903] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:07 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:07.975521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:07.975521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:07.980148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:07.980753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:07.981418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:07.982468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:07.982981 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:07.983825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:08.054049 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:08.062088 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-beb86a7b-b693-4f9c-895a-6914a3094720 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1210 microversion: 2.1 time: 0.095286 Oct 04 12:13:08.062659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 647/904] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:07 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:08.067051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:08.067649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:08.074615 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:08.076013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:08.076013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:08.076448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:08.076896 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:08.077315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:08.141650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:08.150468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cd6c76ff-7767-444d-99b3-e1f709753109 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1214 microversion: 2.1 time: 0.086837 Oct 04 12:13:08.151028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 648/905] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:08 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:08.993378 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:08.994053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:09.001219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:09.001968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:09.002437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:09.003190 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:09.003650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:09.004111 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:09.227453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:09.237633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:09.239276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:09.240718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b6be85ea-045a-49db-930b-2be44e051ed9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.251900 Oct 04 12:13:09.241313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 649/906] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:08 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:09.246291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:09.246950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:09.254229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:09.254747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:09.255238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:09.256474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:09.256968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:09.257389 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:09.340945 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:09.350329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5757a0e2-dff2-4b9a-9e7a-7754a895b688 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1266 microversion: 2.1 time: 0.107893 Oct 04 12:13:09.350938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 650/907] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:09 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:09.355912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:09.356579 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:09.380500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:09.381766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:09.382290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:09.383046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:09.383531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:09.383953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:09.389474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:09.730397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:09.739149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7621e09b-7906-4f88-8620-1b4ef7c01bac tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1278 microversion: 2.1 time: 0.387117 Oct 04 12:13:09.740660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 651/908] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:09 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1278 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:10.273213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:10.275727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:10.286654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:10.288068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:10.288929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:10.290306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:10.291154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:10.291918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:10.413609 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:13:10.414633 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:13:10.715337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:10.728936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:10.732720 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:10.735364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a569f92d-bed1-42f7-b303-faccc838fb53 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.470284 Oct 04 12:13:10.753533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 652/909] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:10 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:13:10.753533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:10.754119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:10.764497 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:10.764992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:10.765467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:10.766181 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:10.766691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:10.767124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:10.879464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:10.889184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b82df23e-de1c-48aa-8d92-d67d67207f36 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1272 microversion: 2.1 time: 0.144730 Oct 04 12:13:10.889789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 653/910] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:10 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:10.895288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:10.898787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:10.903134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:10.903594 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:10.904201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:10.904896 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:10.905349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:10.905772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:11.082503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:11.101972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3528dff9-9c96-49ba-ba08-4cfaacade090 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.210518 Oct 04 12:13:11.103337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 654/911] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:10 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:11.775375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:11.782126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:11.792340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:11.794043 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:11.795196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:11.796621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:11.797449 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:11.798460 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:12.123057 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:12.139341 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:12.142450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:12.145206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3027c91e-b73a-449b-8582-41a2ec7e4eb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.378629 Oct 04 12:13:12.154199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 655/912] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:11 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:12.157427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:12.158305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:12.177621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:12.178762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:12.179726 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:12.182156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:12.184729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:12.186281 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:12.445467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:12.450314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=4 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:12.463276 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9fa1a864-d14e-47bf-894c-0aabe3ed771f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.314078 Oct 04 12:13:12.466538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 656/913] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:12 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:12.473182 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:12.486201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:12.486201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:12.486641 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:12.487440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:12.488712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:12.489565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:12.490342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:12.760533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:12.772012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7e7e3e1b-c2a8-4f0b-84df-9d7eaa6d9f1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.305672 Oct 04 12:13:12.772684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 657/914] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:12 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:12.790996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-44e6c9fe-0aed-44af-81e3-6c244227476f req-079faf70-eec9-43e8-bb52-1addbbddcb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8caf83d-590b-4270-9c88-e1e13d01d021", "tag": "c764ae2c-f9ae-4cdf-85c9-3dae57471eae"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:12.803873 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-44e6c9fe-0aed-44af-81e3-6c244227476f req-079faf70-eec9-43e8-bb52-1addbbddcb74 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:12.805621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-44e6c9fe-0aed-44af-81e3-6c244227476f req-079faf70-eec9-43e8-bb52-1addbbddcb74 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:12.806423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-44e6c9fe-0aed-44af-81e3-6c244227476f req-079faf70-eec9-43e8-bb52-1addbbddcb74 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:12.821925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-44e6c9fe-0aed-44af-81e3-6c244227476f req-079faf70-eec9-43e8-bb52-1addbbddcb74 service nova] Creating event network-changed:c764ae2c-f9ae-4cdf-85c9-3dae57471eae for instance d8caf83d-590b-4270-9c88-e1e13d01d021 on hv-cinder-86021 Oct 04 12:13:12.828443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-44e6c9fe-0aed-44af-81e3-6c244227476f req-079faf70-eec9-43e8-bb52-1addbbddcb74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048719 Oct 04 12:13:12.829080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 658/915] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:13.173020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=16 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:13.179887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:13.180804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:13.187764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:13.188270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:13.188734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:13.189887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:13.190247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:13.190660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:13.334008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:13.343396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:13.344877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:13.346054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f61ed3d1-258c-4a47-b20c-71263d5c09b2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.174884 Oct 04 12:13:13.346614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 659/916] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:13 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:13.351551 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-6f04cd7c-638b-4ef7-8e96-1769dedc38be req-f0ec3d0c-3fc4-4ef9-8cf6-6d2b4f79b57d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2dbacd-38bd-4ded-93fc-7e3d3259166a", "tag": "79609a18-a747-4a88-893d-2213b50543b9"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:13.363434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6f04cd7c-638b-4ef7-8e96-1769dedc38be req-f0ec3d0c-3fc4-4ef9-8cf6-6d2b4f79b57d service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:13.363910 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6f04cd7c-638b-4ef7-8e96-1769dedc38be req-f0ec3d0c-3fc4-4ef9-8cf6-6d2b4f79b57d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:13.364366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-6f04cd7c-638b-4ef7-8e96-1769dedc38be req-f0ec3d0c-3fc4-4ef9-8cf6-6d2b4f79b57d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:13.377425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-6f04cd7c-638b-4ef7-8e96-1769dedc38be req-f0ec3d0c-3fc4-4ef9-8cf6-6d2b4f79b57d service nova] Creating event network-changed:79609a18-a747-4a88-893d-2213b50543b9 for instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a on hv-cinder-86021 Oct 04 12:13:13.383861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-6f04cd7c-638b-4ef7-8e96-1769dedc38be req-f0ec3d0c-3fc4-4ef9-8cf6-6d2b4f79b57d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036030 Oct 04 12:13:13.389468 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 660/917] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:13.488119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:13.488833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:13.496539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:13.497743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:13.497743 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:13.498066 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:13.498480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:13.498904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:13.634905 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:13.646527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b0a96d94-3e42-4322-9f12-ee5e65ce2ca2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.162609 Oct 04 12:13:13.647358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 661/918] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:13 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:13.797349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:13.798251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:13.808505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:13.809055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:13.809537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:13.810289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:13.810866 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:13.811342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:14.036126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:14.048625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-987b40e7-4bf4-4702-a72d-e7c715513833 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.256915 Oct 04 12:13:14.049321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 662/919] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:13 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:14.372650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:14.373265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:14.380051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:14.380575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:14.381059 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:14.381770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:14.382227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:14.382660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:14.525946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:14.535241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:14.537235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:14.538445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8effabdf-7bf9-43ae-b050-6b612c85cf4f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.170044 Oct 04 12:13:14.539040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 663/920] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:14 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:14.673708 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:14.674261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:14.680759 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:14.681254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:14.681689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:14.682416 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:14.682863 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:14.683308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:14.824750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:14.833408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ad0204da-df9a-4685-85ec-56cecdbecc53 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.163593 Oct 04 12:13:14.834494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 664/921] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:14 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:15.071271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:15.071883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:15.081993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:15.081993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:15.081993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:15.081993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:15.082576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:15.082576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:15.234680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:15.250989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c89c7231-881a-4042-be73-26c661bfbe04 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.183254 Oct 04 12:13:15.252243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 665/922] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:15 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:15.578712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:15.580828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:15.594087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:15.595576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:15.596785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:15.598546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:15.600366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:15.601446 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:15.843661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:15.854441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:15.855902 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:15.857300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4b12c376-48c4-459f-8efa-c12aeb66d651 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.293267 Oct 04 12:13:15.857913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 666/923] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:15 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:15.862719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:15.863345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:15.870078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:15.870890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:15.871328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:15.872035 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:15.872795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:15.873197 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.015230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:16.024432 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ffe1bd7c-bebe-4beb-b7ca-d717fce6a826 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.165220 Oct 04 12:13:16.025147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 667/924] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:15 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:16.287359 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:16.287893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:16.295109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.295601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.296041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.296836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.297293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.297776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.471138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:16.479491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-57faadf8-b4fc-4b75-8228-3de7fa39ec49 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.196170 Oct 04 12:13:16.480190 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 668/925] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:16 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:16.892136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:16.893549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:16.900876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.901599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.902307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.903215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:16.903891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:16.904505 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:16.910274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:17.120144 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:17.134510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:17.137485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:17.139167 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5b023391-759b-4ed3-8f9e-620e4cbe8a14 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.254164 Oct 04 12:13:17.140073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 669/926] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:16 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:17.151083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:17.152511 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:17.165419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.169607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.169607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.169607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.170154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.171347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.366877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:17.382233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-18ac0ea2-98af-4139-bdd5-1de193cda0b2 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.240006 Oct 04 12:13:17.383556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 670/927] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:17 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:17.392531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-b6c20ebc-f22f-4007-872f-ca98e7d5c5c0 req-510f18d9-f0de-4a39-a001-74e10a9e75b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eede383-c39e-47b4-8bc0-0aae982633bc", "name": "network-vif-plugged", "status": "completed", "tag": "5746ed9b-3dfc-4c16-9d49-5849d2aeefda"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:17.409963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b6c20ebc-f22f-4007-872f-ca98e7d5c5c0 req-510f18d9-f0de-4a39-a001-74e10a9e75b8 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.410801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b6c20ebc-f22f-4007-872f-ca98e7d5c5c0 req-510f18d9-f0de-4a39-a001-74e10a9e75b8 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.412056 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b6c20ebc-f22f-4007-872f-ca98e7d5c5c0 req-510f18d9-f0de-4a39-a001-74e10a9e75b8 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.435114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-b6c20ebc-f22f-4007-872f-ca98e7d5c5c0 req-510f18d9-f0de-4a39-a001-74e10a9e75b8 service nova] Creating event network-vif-plugged:5746ed9b-3dfc-4c16-9d49-5849d2aeefda for instance 8eede383-c39e-47b4-8bc0-0aae982633bc on hv-cinder-86021 Oct 04 12:13:17.444413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-b6c20ebc-f22f-4007-872f-ca98e7d5c5c0 req-510f18d9-f0de-4a39-a001-74e10a9e75b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058762 Oct 04 12:13:17.445494 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 671/928] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:17.505060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:17.507060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:17.514559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.515117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.515466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.516236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:17.516870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:17.517286 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:17.705586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:17.714827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-582e680d-a7c6-4c8a-8841-48876dd4e8b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.214837 Oct 04 12:13:17.715883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 672/929] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:17 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:18.191208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:18.192611 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:18.203275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.204066 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.204757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.205900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.206636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.207367 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.356161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:18.370633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:18.373172 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:18.375155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2cfb4765-da8b-4f5a-9a7e-ca7be6b1be4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.189924 Oct 04 12:13:18.376247 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 673/930] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:18 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:13:18.413114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:18.413877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:18.421418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.421918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.422349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.423078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.423695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.424132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.603785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:18.619707 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4dd42dae-0cc2-4521-bc66-71ee5dd2e865 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.212188 Oct 04 12:13:18.621027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 674/931] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:18 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:18.739203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:18.740498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:18.747545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.748033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.748502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.749218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:18.749792 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:18.750218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:18.903137 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:18.912738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-86a42ad9-8eff-4f7f-a05a-91bb94dfd71f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.177418 Oct 04 12:13:18.913347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 675/932] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:18 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:19.411810 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:19.412548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:19.420058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.420595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.421034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:19.421775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.422228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.422653 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:19.557852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:19.566804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:19.568791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:19.569944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d3867d2c-bb06-4f7d-9676-f4dd67907220 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.162265 Oct 04 12:13:19.570493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 676/933] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:19 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:19.647715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:19.647715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:19.657394 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.658157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.668566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:19.668566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.668566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.668566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:19.835766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:19.838885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-649d5920-cd13-4f5d-b717-c15914962a7f tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.198207 Oct 04 12:13:19.839485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 677/934] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:19 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:19.939174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:19.939999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:19.947876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.948880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.949406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:19.950782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:19.950782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:19.951221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:20.137811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:20.146783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4618141b-f8a9-480f-a42b-89b60fdb6dfe tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.212453 Oct 04 12:13:20.147783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 678/935] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:19 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:20.378990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-9d87ce22-1ff1-4158-be0f-dbb58f558ef4 req-bf12f534-9420-4f78-837c-c2bbdc066649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2dbacd-38bd-4ded-93fc-7e3d3259166a", "name": "network-vif-plugged", "status": "completed", "tag": "79609a18-a747-4a88-893d-2213b50543b9"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:20.390524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9d87ce22-1ff1-4158-be0f-dbb58f558ef4 req-bf12f534-9420-4f78-837c-c2bbdc066649 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:20.391317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9d87ce22-1ff1-4158-be0f-dbb58f558ef4 req-bf12f534-9420-4f78-837c-c2bbdc066649 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:20.392323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9d87ce22-1ff1-4158-be0f-dbb58f558ef4 req-bf12f534-9420-4f78-837c-c2bbdc066649 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:20.405737 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-9d87ce22-1ff1-4158-be0f-dbb58f558ef4 req-bf12f534-9420-4f78-837c-c2bbdc066649 service nova] Creating event network-vif-plugged:79609a18-a747-4a88-893d-2213b50543b9 for instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a on hv-cinder-86021 Oct 04 12:13:20.411590 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-9d87ce22-1ff1-4158-be0f-dbb58f558ef4 req-bf12f534-9420-4f78-837c-c2bbdc066649 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Oct 04 12:13:20.412332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 679/936] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:13:20.596974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:20.597725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:20.606029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:20.606560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:20.607242 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:20.608209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:20.608703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:20.609143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:20.777956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:20.793687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:20.796850 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:20.799062 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ec1a470c-66f7-4fe1-845e-894712c67127 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.206419 Oct 04 12:13:20.803594 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 680/937] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:20 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:20.864386 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:20.865724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:20.871574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:20.873630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:20.874219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:20.874790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:20.875604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:20.876116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:20.877041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.058314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:21.066741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8854552f-d307-4572-89d0-4d7c52d12bdc tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.207168 Oct 04 12:13:21.067395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 681/938] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:20 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:21.174588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:21.177663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:21.182283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.182777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.183219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.184253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.184720 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.185150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.351852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:21.360337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3f30ca5f-64e2-4160-8b10-8f86dcd4095a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.189691 Oct 04 12:13:21.360981 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 682/939] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:21 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:21.826644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:21.827395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:21.834842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.835366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.835773 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.836519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:21.836973 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:21.837391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:21.994022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:22.003727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:22.005894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:22.007109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-47535615-2f2f-4798-b9a1-b40024635fa3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1809 microversion: 2.20 time: 0.184603 Oct 04 12:13:22.013393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 683/940] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:21 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:22.094151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:22.095303 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:22.104016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:22.104584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:22.105028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:22.105786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:22.106304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:22.106762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:22.253348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:22.262749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cd5b0d93-fcb6-4204-954d-8122d29c24da tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1314 microversion: 2.1 time: 0.175464 Oct 04 12:13:22.263351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 684/941] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:22 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:22.384342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:22.384967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:22.391467 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:22.391953 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:22.392426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:22.393132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:22.393586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:22.394063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:22.547768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:22.556683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6286a5a0-2983-4ea0-9415-4e5a1c591cb6 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.176788 Oct 04 12:13:22.557265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 685/942] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:22 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:22.561860 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-b6ce9f6e-cda6-4af2-b825-6978d9fba179 req-5d93ff79-4f03-43c2-9d61-7a4f0626b680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8caf83d-590b-4270-9c88-e1e13d01d021", "name": "network-vif-plugged", "status": "completed", "tag": "c764ae2c-f9ae-4cdf-85c9-3dae57471eae"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:22.571453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b6ce9f6e-cda6-4af2-b825-6978d9fba179 req-5d93ff79-4f03-43c2-9d61-7a4f0626b680 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:22.571930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b6ce9f6e-cda6-4af2-b825-6978d9fba179 req-5d93ff79-4f03-43c2-9d61-7a4f0626b680 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:22.572437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b6ce9f6e-cda6-4af2-b825-6978d9fba179 req-5d93ff79-4f03-43c2-9d61-7a4f0626b680 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:22.583742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-b6ce9f6e-cda6-4af2-b825-6978d9fba179 req-5d93ff79-4f03-43c2-9d61-7a4f0626b680 service nova] Creating event network-vif-plugged:c764ae2c-f9ae-4cdf-85c9-3dae57471eae for instance d8caf83d-590b-4270-9c88-e1e13d01d021 on hv-cinder-86021 Oct 04 12:13:22.589188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-b6ce9f6e-cda6-4af2-b825-6978d9fba179 req-5d93ff79-4f03-43c2-9d61-7a4f0626b680 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030558 Oct 04 12:13:22.590003 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 686/943] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:23.051906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:23.052678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:23.059931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.061018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.061527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:23.062748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.063571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.064421 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:23.234187 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:23.238412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:23.245534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:23.247163 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:23.248414 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-13d15b65-28e9-4f12-ad46-e062683cbdbb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1796 microversion: 2.20 time: 0.202019 Oct 04 12:13:23.249033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 687/944] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:13:23 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1796 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:13:23.287098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:23.287720 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:23.294293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.294787 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.296372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:23.296372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.296734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.296915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:23.451239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:23.459458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-aca6dbcb-8925-4763-b1de-7eee578efa0d tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1464 microversion: 2.1 time: 0.177163 Oct 04 12:13:23.460043 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 688/945] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:23 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:23.508748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:23.509277 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:23.515489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.515979 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.516445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:23.517146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.517600 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.518025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:23.545338 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:13:23.843270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f5b8f803-f6e3-4b1c-baad-021affea23a1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 204 len: 0 microversion: 2.1 time: 0.338114 Oct 04 12:13:23.843954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 689/946] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:13:23 2022] DELETE /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:13:23.850603 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:23.857472 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:23.857838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.858333 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.858771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:23.859486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:23.859936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:23.860410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:24.010977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:24.019374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-29db535a-8b4e-4c09-a70f-f24210c8af60 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.173904 Oct 04 12:13:24.019965 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 690/947] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:23 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:24.024670 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:24.025283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:24.031691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:24.032195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:24.032716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:24.033434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:24.033892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:24.034314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:24.179022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:24.187602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-30b7a8a2-5fdf-49f4-a960-9b2756c93539 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1470 microversion: 2.1 time: 0.166494 Oct 04 12:13:24.188219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 691/948] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:24 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:25.045428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:25.046263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:25.057030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.057805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.058577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.059832 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.060668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.061422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.216338 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:25.224943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c681ae5f-1aeb-450d-8de4-10eaac8c7e1d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.185797 Oct 04 12:13:25.225522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 692/949] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:25 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:25.230179 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:25.230791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:25.240788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.241809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.242613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.243912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:25.244789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:25.245573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:25.391489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:25.399741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3868a540-487e-4863-89ba-1455efdff8c1 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1470 microversion: 2.1 time: 0.173156 Oct 04 12:13:25.400345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 693/950] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:25 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1470 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:26.257841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:26.258656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:26.265763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:26.266253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:26.266691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:26.267410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:26.267857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:26.268312 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:26.444983 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:26.454993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1c131f3b-bbba-4210-92c5-fca85c79d963 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1318 microversion: 2.1 time: 0.201119 Oct 04 12:13:26.455715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 694/951] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:26 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:26.461980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:26.462693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:26.470422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:26.474136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:26.474136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:26.474136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:26.474136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:26.474880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:26.624629 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:26.635084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7e97e4b6-10f3-4bc7-9758-50f1626b115c tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1470 microversion: 2.1 time: 0.177860 Oct 04 12:13:26.642464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 695/952] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:26 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:27.480780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:27.481479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:27.488746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:27.489770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:27.490217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:27.490956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:27.491412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:27.491836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:27.653542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:27.675990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-535062ee-46b9-4da2-abd7-983d7ff7582e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1506 microversion: 2.1 time: 0.189223 Oct 04 12:13:27.677965 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 696/953] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:27 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:27.683957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:27.684934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:27.694433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:27.695495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:27.696566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:27.701023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:27.701023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:27.701023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:27.813255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:27.826939 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8232784e-bf89-4c3f-a988-0b2fad694b40 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1428 microversion: 2.1 time: 0.147345 Oct 04 12:13:27.828427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 697/954] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:27 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1428 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:13:28.005533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-71fe8e4b-662d-4958-bcbe-fb250fa89e8a req-dcb53b98-428f-4014-8696-bef354571be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2dbacd-38bd-4ded-93fc-7e3d3259166a", "name": "network-vif-deleted", "tag": "79609a18-a747-4a88-893d-2213b50543b9"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:28.016017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-71fe8e4b-662d-4958-bcbe-fb250fa89e8a req-dcb53b98-428f-4014-8696-bef354571be5 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:28.016438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-71fe8e4b-662d-4958-bcbe-fb250fa89e8a req-dcb53b98-428f-4014-8696-bef354571be5 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:28.016941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-71fe8e4b-662d-4958-bcbe-fb250fa89e8a req-dcb53b98-428f-4014-8696-bef354571be5 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:28.031729 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-71fe8e4b-662d-4958-bcbe-fb250fa89e8a req-dcb53b98-428f-4014-8696-bef354571be5 service nova] Creating event network-vif-deleted:79609a18-a747-4a88-893d-2213b50543b9 for instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a on hv-cinder-86021 Oct 04 12:13:28.039045 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-71fe8e4b-662d-4958-bcbe-fb250fa89e8a req-dcb53b98-428f-4014-8696-bef354571be5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208591 Oct 04 12:13:28.040412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 698/955] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:13:28.569861 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:13:28.570751 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:13:28.853866 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:28.858078 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:28.862158 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:28.862672 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:28.863123 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:28.863916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:28.864427 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:28.864858 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:28.901559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:28.902102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:28.902543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:28.904477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lazy-loading 'fault' on Instance uuid 0c2dbacd-38bd-4ded-93fc-7e3d3259166a {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:13:28.947815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f685bdbb59f4d4b9eb68e82beedf195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8feaa0c5e9349cc8e2dcc3d59120aa9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:13:28.958716 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a836bac2-58e7-45d1-9cf5-72708480ac43 tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 200 len: 1304 microversion: 2.1 time: 0.110332 Oct 04 12:13:28.959397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 699/956] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:28 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:13:29.983567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:13:29.984282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] [instance: 0c2dbacd-38bd-4ded-93fc-7e3d3259166a] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:29.991189 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:29.991680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:29.992130 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:29.992879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:29.993335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:29.993765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:30.009670 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] HTTP exception thrown: Instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a could not be found. Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Request method failure captured: Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a HTTP/1.1 Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCNLjAPVxeti2xtx2QTZYgvlYsW4QdbfxXrcJiG1RjgkYHKBQm9oWpZj-aEjKnZFF5KWl7zy2jsSO3Z280PT7_oFysLXfAx4l6qGBG2q94aU92l_Qktd-3oraQ1RpvJyigR6PGfnC4qM_odeG-TBdYwk10or1aLwJBXYvWXw1CKBrEA Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: f8feaa0c5e9349cc8e2dcc3d59120aa9 Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesNegativeTest-53947662 Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:13:30.013090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f8feaa0c5e9349cc8e2dcc3d59120aa9", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f8feaa0c5e9349cc8e2dcc3d59120aa9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f8feaa0c5e9349cc8e2dcc3d59120aa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f8feaa0c5e9349cc8e2dcc3d59120aa9"}]}] Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesNegativeTest-53947662 Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: f8feaa0c5e9349cc8e2dcc3d59120aa9 Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesNegativeTest-53947662 Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesNegativeTest-53947662-project Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 1f685bdbb59f4d4b9eb68e82beedf195 Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesNegativeTest-53947662-project Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a could not be found. Oct 04 12:13:30.015572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '0c2dbacd-38bd-4ded-93fc-7e3d3259166a'} Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a could not be found. Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:13:30.016549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a could not be found. Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a could not be found. Oct 04 12:13:30.017918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:13:30.019272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] Returning 404 to user: Instance 0c2dbacd-38bd-4ded-93fc-7e3d3259166a could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:13:30.019272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fe9ceada-37ef-42e4-a883-fb13b0713bdf tempest-VolumesNegativeTest-53947662 tempest-VolumesNegativeTest-53947662-project] 10.222.0.15 "GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a" status: 404 len: 111 microversion: 2.1 time: 0.035482 Oct 04 12:13:30.019272 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 700/957] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:13:29 2022] GET /compute/v2.1/servers/0c2dbacd-38bd-4ded-93fc-7e3d3259166a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:13:50.029298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "288631ef-9e31-448a-988f-8529fe7b74a7", "device": "/dev/sdb"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:13:50.032381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:13:50.036253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:50.037016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:13:50.042741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:50.043227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:50.043657 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:50.044393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:13:50.044841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:13:50.045326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:13:51.105164 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-80542a64-45ee-464d-a2ac-d259ed2fcc53 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "POST /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.080009 Oct 04 12:13:51.106329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 701/958] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:13:50 2022] POST /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:14:13.676609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:13.677790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:13.680903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:13.681747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:13.687593 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:13.688090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:13.688573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:13.689300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:13.689764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:13.690698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:13.731407 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d742e343-63e8-4679-99dc-a8ab1ebf8225 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments/bea5233f-324c-45cd-955a-52bdde042830" status: 200 len: 194 microversion: 2.20 time: 0.059406 Oct 04 12:14:13.732208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 702/959] 10.222.0.15 () {60 vars in 1454 bytes} [Tue Oct 4 12:14:13 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments/bea5233f-324c-45cd-955a-52bdde042830 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:14:13.814438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:13.815087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:13.824145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:13.824789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:13.825314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:13.826432 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:13.827018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:13.827509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:13.977362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lazy-loading 'services' on Instance uuid 8eede383-c39e-47b4-8bc0-0aae982633bc {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:14:14.333448 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b8bc69c1-e61d-42e7-aabd-e0af4a379997 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments/bea5233f-324c-45cd-955a-52bdde042830" status: 202 len: 0 microversion: 2.20 time: 0.523505 Oct 04 12:14:14.334173 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 703/960] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Oct 4 12:14:13 2022] DELETE /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments/bea5233f-324c-45cd-955a-52bdde042830 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:14:14.348201 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:14.352782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:14.363004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:14.365668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:14.365668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:14.365668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:14.365668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:14.366230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:14.402667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-45f66d44-e180-4b0e-8638-e2201020b350 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062939 Oct 04 12:14:14.403263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 704/961] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Oct 4 12:14:14 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:14:15.419602 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:15.421927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:15.430127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:15.430915 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:15.431304 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:15.432127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:15.432765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:15.433265 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:15.468856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b75a8a82-83a3-49c8-8425-ce6573eed2b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053411 Oct 04 12:14:15.469673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 705/962] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Oct 4 12:14:15 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:14:16.483308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:16.485789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:16.494161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:16.494662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:16.495108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:16.495836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:16.496327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:16.496759 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:16.532777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fd9c1440-00d0-4f03-96c3-a74d813d1d60 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053908 Oct 04 12:14:16.533380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 706/963] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Oct 4 12:14:16 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:16.615601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:16.616349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:16.623472 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:16.632423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:16.632423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:16.632423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:16.632423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:16.633082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:16.655988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:14:17.076412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0ecc2a0b-d80f-4408-bb1b-cc40ad4327e9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 204 len: 0 microversion: 2.20 time: 0.464738 Oct 04 12:14:17.077104 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 707/964] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 4 12:14:16 2022] DELETE /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 12:14:17.086686 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:17.087408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:17.094286 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:17.094782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:17.095227 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:17.095960 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:17.096474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:17.096932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:17.315121 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:17.315121 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:17.315479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:17.315479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6d86e129-bf86-4db9-b3ee-7c599234b92c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.216111 Oct 04 12:14:17.315479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 708/965] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:17 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:18.326850 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:18.327969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:18.335454 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:18.336007 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:18.336577 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:18.337408 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:18.337883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:18.338361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:18.502022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:18.512350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:18.514029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:18.515411 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c2de4e7c-2fff-431a-addf-b33b591d508f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.192717 Oct 04 12:14:18.515988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 709/966] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:18 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:19.542636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:19.543948 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:19.553370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:19.554224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:19.554777 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:19.555678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:19.556293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:19.556829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:19.734052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:19.744533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:19.746129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:19.747975 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e953a51c-8040-4f99-ab40-2af25a55bd63 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1724 microversion: 2.20 time: 0.209929 Oct 04 12:14:19.748894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 710/967] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:19 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:19.871023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:19.871666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:19.879861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:19.880842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:19.881761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:19.883072 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:19.883901 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:19.884722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:20.009250 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lazy-loading 'services' on Instance uuid d8caf83d-590b-4270-9c88-e1e13d01d021 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:14:20.323559 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9422f913-a12d-40f1-b170-010c910d8b78 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021/os-volume_attachments/288631ef-9e31-448a-988f-8529fe7b74a7" status: 202 len: 0 microversion: 2.1 time: 0.456572 Oct 04 12:14:20.324909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 711/968] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:14:19 2022] DELETE /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021/os-volume_attachments/288631ef-9e31-448a-988f-8529fe7b74a7 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:14:20.447649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-dcb7ccc2-c79e-4598-a80b-f01ba9f9671a req-a7e29eaf-c55b-4023-bb78-f900405d24bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eede383-c39e-47b4-8bc0-0aae982633bc", "name": "network-vif-deleted", "tag": "5746ed9b-3dfc-4c16-9d49-5849d2aeefda"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:20.476205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-dcb7ccc2-c79e-4598-a80b-f01ba9f9671a req-a7e29eaf-c55b-4023-bb78-f900405d24bc service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:20.476205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-dcb7ccc2-c79e-4598-a80b-f01ba9f9671a req-a7e29eaf-c55b-4023-bb78-f900405d24bc service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:20.476205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-dcb7ccc2-c79e-4598-a80b-f01ba9f9671a req-a7e29eaf-c55b-4023-bb78-f900405d24bc service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:20.494212 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-dcb7ccc2-c79e-4598-a80b-f01ba9f9671a req-a7e29eaf-c55b-4023-bb78-f900405d24bc service nova] Creating event network-vif-deleted:5746ed9b-3dfc-4c16-9d49-5849d2aeefda for instance 8eede383-c39e-47b4-8bc0-0aae982633bc on hv-cinder-86021 Oct 04 12:14:20.507230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-dcb7ccc2-c79e-4598-a80b-f01ba9f9671a req-a7e29eaf-c55b-4023-bb78-f900405d24bc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067529 Oct 04 12:14:20.509127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 712/969] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:20.780834 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:20.782138 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:20.802046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:20.802715 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:20.804798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:20.804798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:20.805235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:20.806849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:20.896103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:20.907422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:20.910084 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:20.911367 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7912a173-71cc-4b74-83af-1492e7b3da92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1367 microversion: 2.20 time: 0.137407 Oct 04 12:14:20.912016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 713/970] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:20 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1367 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:21.954018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:21.954727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:21.961720 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:21.962207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:21.962643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:21.963356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:21.963805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:21.964257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:22.002020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:22.002522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:22.002951 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:22.003411 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lazy-loading 'fault' on Instance uuid 8eede383-c39e-47b4-8bc0-0aae982633bc {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:14:22.048627 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:22.058053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:22.060614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:22.062635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a228f82b-d9a4-43c5-aa6d-c11d416fed8d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 200 len: 1372 microversion: 2.20 time: 0.112959 Oct 04 12:14:22.063457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 714/971] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:21 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:22.635397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:22.635899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:22.642582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:22.643067 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:22.643502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:22.644250 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:22.644800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:22.645929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:22.675973 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:14:22.679496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:23.196613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ce2639b7-979c-42bb-b6b1-04dbb367452d tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 204 len: 0 microversion: 2.1 time: 0.564783 Oct 04 12:14:23.197338 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 715/972] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:14:22 2022] DELETE /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:14:23.203986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:23.204818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:23.211779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:23.212294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:23.212724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:23.213435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:23.213892 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:23.214309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:23.230383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] HTTP exception thrown: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Request method failure captured: Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc HTTP/1.1 Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLLpVCmpeqs4CYzDE9xK22aSZJ8LCYwOhUZ2nfyNremRVPo7anjFShtKK112SFVyJ6pTwua-1m7HwJnxKKcwEcocrGlhgK2KVKoXDVY2lnHaajvy4legJcy1iIe1zenMzQBD15qGLKY4RdRRshax2T4Xwd7Wv-h3r8BiWUSSzDh_rA Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:14:23.232942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e41d4317234c458daad66f591d27c6fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}] Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 9ab97a61223f4719add7b3c0f845a319 Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:14:23.235564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '8eede383-c39e-47b4-8bc0-0aae982633bc'} Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:14:23.237776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:14:23.240073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:23.242241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Returning 404 to user: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:14:23.242241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bb681ae7-f511-49d8-a6a7-9072479a72c6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 404 len: 111 microversion: 2.20 time: 0.035827 Oct 04 12:14:23.242241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 716/973] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:23 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 12:14:23.242241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:23.242241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:23.247809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:23.254640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:23.254640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:23.254640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:23.254640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:23.255447 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:23.400629 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:23.409615 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-981d9ca9-6d98-4d3f-8825-db283677596f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1512 microversion: 2.1 time: 0.173379 Oct 04 12:14:23.410210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 717/974] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:23 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:23.415244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b60d5ff5-3e19-4f99-98ba-4cb95dceb750 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '.version_select at 0x7f10c70391f0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:23.518127 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b60d5ff5-3e19-4f99-98ba-4cb95dceb750 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687265955" status: 204 len: 0 microversion: 2.20 time: 0.106666 Oct 04 12:14:23.518596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 718/975] 10.222.0.15 () {60 vars in 1262 bytes} [Tue Oct 4 12:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687265955 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 12:14:24.448884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:24.450083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:24.458195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:24.458686 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:24.459120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:24.459995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:24.460493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:24.460919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:24.682584 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:24.691401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-261c244c-807b-40cb-a493-f2bcbd95794f tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1512 microversion: 2.1 time: 0.248555 Oct 04 12:14:24.692023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 719/976] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:24 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:24.696869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3d79ab40-c3f9-4305-9d01-5ad8a68cfd56 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'create', calling method: .version_select at 0x7f10c3597040>, body: {"keypair": {"name": "tempest-keypair-298529947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAqzZVxDybpN2NCZQzV4qslvilOwus/+5aPb23ofXl8ey6rMKeRqh5tjP8CyjdXhJbAS1b7kh/gu6dsTAYCEiaec4BusjO0kXQNDIUZbkxy/y1NmT5hgdmVW8fdEQPkfQ=="}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:24.714731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-3d79ab40-c3f9-4305-9d01-5ad8a68cfd56 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for project e41d4317234c458daad66f591d27c6fa. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:14:24.719905 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-3d79ab40-c3f9-4305-9d01-5ad8a68cfd56 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for user 9ab97a61223f4719add7b3c0f845a319 and project e41d4317234c458daad66f591d27c6fa. Resources: {'key_pairs'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:14:24.850184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3d79ab40-c3f9-4305-9d01-5ad8a68cfd56 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.157036 Oct 04 12:14:24.850808 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 720/977] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Oct 4 12:14:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 12:14:25.722501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:25.723811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:25.737228 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:25.738215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:25.739240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:25.740548 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:25.741446 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:25.742400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:26.074675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:26.074675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fee1521b-6be6-400f-abae-8c88d6f9caa9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1512 microversion: 2.1 time: 0.216087 Oct 04 12:14:26.074675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 721/978] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:25 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:26.142024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-8b433b50-2fa2-4a4d-aefb-760f6235696f req-eaac4e77-1a9a-4872-8658-72be5ea51bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8caf83d-590b-4270-9c88-e1e13d01d021", "name": "network-vif-deleted", "tag": "c764ae2c-f9ae-4cdf-85c9-3dae57471eae"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:26.152463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-8b433b50-2fa2-4a4d-aefb-760f6235696f req-eaac4e77-1a9a-4872-8658-72be5ea51bcf service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:26.153116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-8b433b50-2fa2-4a4d-aefb-760f6235696f req-eaac4e77-1a9a-4872-8658-72be5ea51bcf service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:26.153666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-8b433b50-2fa2-4a4d-aefb-760f6235696f req-eaac4e77-1a9a-4872-8658-72be5ea51bcf service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:26.168300 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-8b433b50-2fa2-4a4d-aefb-760f6235696f req-eaac4e77-1a9a-4872-8658-72be5ea51bcf service nova] Creating event network-vif-deleted:c764ae2c-f9ae-4cdf-85c9-3dae57471eae for instance d8caf83d-590b-4270-9c88-e1e13d01d021 on hv-cinder-86021 Oct 04 12:14:26.173091 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-8b433b50-2fa2-4a4d-aefb-760f6235696f req-eaac4e77-1a9a-4872-8658-72be5ea51bcf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035607 Oct 04 12:14:26.174325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 722/979] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:14:26.961943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:26.964156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:26.977357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:26.978135 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:26.978900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:26.980218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:26.981050 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:26.981804 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:27.022400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:27.022887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:27.023322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:27.023778 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lazy-loading 'fault' on Instance uuid d8caf83d-590b-4270-9c88-e1e13d01d021 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:14:27.078499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:27.091347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-345f98e5-0cc1-4882-b6dc-621c2dd666c0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 200 len: 1308 microversion: 2.1 time: 0.136542 Oct 04 12:14:27.092991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 723/980] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:26 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:28.045030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1227074565", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "550b30d0-e72b-4d9f-9e1c-c1995429feb1"}], "security_groups": [{"name": "tempest-securitygroup--1960609431"}], "key_name": "tempest-keypair-298529947", "user_data": "}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:28.177701 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] validate_networks() for [('550b30d0-e72b-4d9f-9e1c-c1995429feb1', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:14:28.715660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:14:28.716263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:14:28.721298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:14:28.721298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:14:28.721298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:14:28.728632 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:28.729115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:28.729607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:28.730357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:28.730908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:28.731330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:28.751316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for project e41d4317234c458daad66f591d27c6fa. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:14:28.756624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Getting quotas for user 9ab97a61223f4719add7b3c0f845a319 and project e41d4317234c458daad66f591d27c6fa. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:14:28.770484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:14:28.772785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:14:28.953493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-89334517-a770-4f64-ab67-b0032a31a13f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.916221 Oct 04 12:14:28.954643 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 724/981] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Oct 4 12:14:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 12:14:28.964533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:28.965313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: d8caf83d-590b-4270-9c88-e1e13d01d021] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:28.978318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:28.979149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:28.979923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:28.981189 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:28.982031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:28.982852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:29.002956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] HTTP exception thrown: Instance d8caf83d-590b-4270-9c88-e1e13d01d021 could not be found. Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Request method failure captured: Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 HTTP/1.1 Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCNFnGr5g-pVGSoOcgxT80btEUHS5pn59AYg7s2bnHoT5EDvztUkqbmZv2KUO9_ythduMsSnbeXcaN7mlhYtxfPDEbKCP6u5nWVf_QwddLPWrVxdQevmxXMdpBjXu0Z7aTFOnqpZvub102dsOh6xEuYzR123N6RArR-aPyofy3mclG8 Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 23ef9812a3194dcb9c88e284be7e3982 Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1924315345 Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:14:29.005974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_23ef9812a3194dcb9c88e284be7e3982", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23ef9812a3194dcb9c88e284be7e3982"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/23ef9812a3194dcb9c88e284be7e3982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23ef9812a3194dcb9c88e284be7e3982"}]}] Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesSnapshotTestJSON-1924315345 Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 23ef9812a3194dcb9c88e284be7e3982 Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1924315345 Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesSnapshotTestJSON-1924315345-project Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: cf86d2ca271e4828ba8ce6cb78b2c2b4 Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesSnapshotTestJSON-1924315345-project Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance d8caf83d-590b-4270-9c88-e1e13d01d021 could not be found. Oct 04 12:14:29.008410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'd8caf83d-590b-4270-9c88-e1e13d01d021'} Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8caf83d-590b-4270-9c88-e1e13d01d021 could not be found. Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:14:29.016909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8caf83d-590b-4270-9c88-e1e13d01d021 could not be found. Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8caf83d-590b-4270-9c88-e1e13d01d021 could not be found. Oct 04 12:14:29.020342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:29.023484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Returning 404 to user: Instance d8caf83d-590b-4270-9c88-e1e13d01d021 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:14:29.023484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3fda9beb-6e1c-4a8a-a986-71f3a7c4e012 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021" status: 404 len: 111 microversion: 2.1 time: 0.051373 Oct 04 12:14:29.023484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 725/982] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:28 2022] GET /compute/v2.1/servers/d8caf83d-590b-4270-9c88-e1e13d01d021 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:14:29.023484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3a7c1ad4-d605-4130-95ae-71ee9fb2901c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:29.023484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3a7c1ad4-d605-4130-95ae-71ee9fb2901c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:29.103905 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3a7c1ad4-d605-4130-95ae-71ee9fb2901c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:29.119238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3a7c1ad4-d605-4130-95ae-71ee9fb2901c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:29.122387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3a7c1ad4-d605-4130-95ae-71ee9fb2901c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:29.124614 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3a7c1ad4-d605-4130-95ae-71ee9fb2901c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1281 microversion: 2.20 time: 0.113290 Oct 04 12:14:29.125663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 726/983] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:29 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:14:30.163251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:30.164092 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:30.172449 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:30.172944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:30.173383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:30.174676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:30.175136 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:30.175587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:30.240380 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:30.249063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:30.250529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:30.251652 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4cd83fab-2363-4da5-8dbf-7cdd180d60a8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1285 microversion: 2.20 time: 0.093094 Oct 04 12:14:30.252546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 727/984] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:30 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:31.277799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:31.278568 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:31.282883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:31.287788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:31.288526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:31.289089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:31.289888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:31.290394 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:31.290885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:31.365870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:31.374939 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:31.376595 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:31.378041 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a6630026-8e5b-46f2-875d-20cfef8eeace tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1285 microversion: 2.20 time: 0.104798 Oct 04 12:14:31.378609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 728/985] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:31 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:32.404576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:32.405328 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:32.412862 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:32.413362 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:32.413793 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:32.414515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:32.414968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:32.415392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:32.757518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:32.766695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:32.768322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:32.769501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5b2b15a2-8fb9-4ad4-9edf-ca92ef529a78 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1285 microversion: 2.20 time: 0.369634 Oct 04 12:14:32.770090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 729/986] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:32 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1285 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:33.803842 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:33.806310 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:33.818658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:33.819506 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:33.820309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:33.821528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:33.822556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:33.823260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:33.947002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:33.961274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:33.962502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:33.964666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-972e1c31-dffd-405d-9007-2119d2367cb4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1333 microversion: 2.20 time: 0.171387 Oct 04 12:14:33.965721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 730/987] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:33 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:14:35.015317 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:35.016775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:35.026957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:35.027750 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:35.028487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:35.029588 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:35.030116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:35.030620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:35.156209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:35.181828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:35.193990 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:35.200077 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9ca7ef7c-43a4-4f47-b1cb-a03d3e57b341 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1341 microversion: 2.20 time: 0.185836 Oct 04 12:14:35.200077 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 731/988] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:35 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:35.479698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:35.480747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:35.493491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:35.494419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:35.495241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:35.496628 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:35.497490 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:35.498283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:35.551994 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:14:35.991257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8f2b3758-2f9f-4e83-9a61-e9586aa72394 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 204 len: 0 microversion: 2.1 time: 0.520237 Oct 04 12:14:35.996916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 732/989] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:14:35 2022] DELETE /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:14:35.998163 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-8f13312b-2f20-47c1-a16e-b768c5cb0a0e req-06c875dc-0767-47b8-9853-2628923586ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa30ac5-5c3d-4440-be77-ec7f7ba22389", "tag": "faca2777-bf01-421f-9263-4a3fd0fb6283"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:36.019929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-8f13312b-2f20-47c1-a16e-b768c5cb0a0e req-06c875dc-0767-47b8-9853-2628923586ee service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:36.021063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-8f13312b-2f20-47c1-a16e-b768c5cb0a0e req-06c875dc-0767-47b8-9853-2628923586ee service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:36.021063 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-8f13312b-2f20-47c1-a16e-b768c5cb0a0e req-06c875dc-0767-47b8-9853-2628923586ee service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:36.035083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-8f13312b-2f20-47c1-a16e-b768c5cb0a0e req-06c875dc-0767-47b8-9853-2628923586ee service nova] Creating event network-changed:faca2777-bf01-421f-9263-4a3fd0fb6283 for instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 on hv-cinder-86021 Oct 04 12:14:36.040942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-8f13312b-2f20-47c1-a16e-b768c5cb0a0e req-06c875dc-0767-47b8-9853-2628923586ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047431 Oct 04 12:14:36.041572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 733/990] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:36.050653 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:36.051396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:36.062936 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:36.063829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:36.065209 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:36.066524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:36.067645 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:36.068465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:36.264527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:36.275036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-aa0a442b-0d14-4a75-8421-1660ae9de2ae tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1456 microversion: 2.1 time: 0.228817 Oct 04 12:14:36.280930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 734/991] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:36 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1456 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:36.281255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:36.282565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:36.291029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:36.291537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:36.291977 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:36.292745 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:36.293206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:36.293635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:36.298529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:36.479644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:36.494483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:36.497762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:36.499933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ade7c869-0939-45d5-95d8-a7b906e7b61f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.222747 Oct 04 12:14:36.501026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 735/992] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:36 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:14:37.315667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:37.316483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:37.324335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.324831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.325273 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.325999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.326455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.326918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.489364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:37.497807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-caa0878e-6993-4cf4-8ac9-ab7266274b80 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1456 microversion: 2.1 time: 0.186927 Oct 04 12:14:37.498472 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 736/993] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:37 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1456 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:37.543268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:37.543887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:37.551316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.551813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.552327 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.553051 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:37.553509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:37.553951 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:37.699887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:37.712992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:37.714465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:37.715644 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-60e8ffcd-8ee3-47d1-843d-8dff574def6b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.176490 Oct 04 12:14:37.716540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 737/994] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:37 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:38.521989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:38.522924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:38.530004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:38.530496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:38.530996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:38.531754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:38.532246 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:38.532685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:38.699525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:38.708933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-53433a4f-f824-46a2-ad2b-02878f4c0366 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1456 microversion: 2.1 time: 0.190964 Oct 04 12:14:38.709527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 738/995] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:38 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1456 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:38.741904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:38.742695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:38.744912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:38.750826 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:38.754207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:38.754207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:38.754207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:38.754207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:38.754759 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:38.909619 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:38.919246 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:38.920844 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:38.922046 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0dd59efd-c747-4ff1-831c-42f8a3ab06c4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.184614 Oct 04 12:14:38.922627 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 739/996] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:38 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:39.739880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:39.740991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:39.744015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=12 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:39.752747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:39.758626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:39.758626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:39.758626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:39.758626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:39.759562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:40.031018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:40.051638 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8d0b862e-fca4-4635-8e18-b3f25a4fe329 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1456 microversion: 2.1 time: 0.316778 Oct 04 12:14:40.053165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 740/997] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:39 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1456 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:40.063221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:40.064402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:40.077195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:40.080237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:40.081556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:40.087284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:40.088791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:40.089951 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:40.341398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:40.353370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:40.354854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:40.356029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-016a8491-8c51-4a48-ae55-27a5688a4a97 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.301321 Oct 04 12:14:40.356655 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 741/998] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:40 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:14:40.361756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-432229464", "imageRef": "89722145-55a8-4479-9f0b-8e9cf2f8456d", "flavorRef": "452", "networks": [{"uuid": "993e7e45-b57b-466d-b327-7943e445df81"}]}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:40.428681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.network.neutron [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] validate_networks() for [('993e7e45-b57b-466d-b327-7943e445df81', None, None, None, None, None)] {{(pid=133083) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 12:14:41.138837 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Flavor limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 12:14:41.140117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Image limits 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 12:14:41.140637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Flavor pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 12:14:41.141447 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Image pref 0:0:0 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 12:14:41.142189 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.virt.hardware [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133083) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 12:14:41.153630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.154372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.154973 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:41.155876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.156564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.164531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:41.177021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Getting quotas for project 23ef9812a3194dcb9c88e284be7e3982. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 12:14:41.182651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.quota [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Getting quotas for user cf86d2ca271e4828ba8ce6cb78b2c2b4 and project 23ef9812a3194dcb9c88e284be7e3982. Resources: {'cores', 'ram', 'instances'} {{(pid=133083) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 12:14:41.198869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Going to run 1 instances... {{(pid=133083) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 12:14:41.201324 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='89722145-55a8-4479-9f0b-8e9cf2f8456d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133083) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 12:14:41.349746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5e86b461-9f7a-4d13-8321-cbf1c76068cd tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991951 Oct 04 12:14:41.350426 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 742/999] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:14:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 12:14:41.554432 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-05eb850f-cd2d-4539-a16b-d11915d66e63 req-d1f25152-401b-4430-ac39-82e6b1c1aa9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53adef1b-9c39-4311-9718-5a32a60b9bc5", "tag": "ff37dcc9-d53c-4424-bdd4-b2400ee2d656"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:41.564613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-05eb850f-cd2d-4539-a16b-d11915d66e63 req-d1f25152-401b-4430-ac39-82e6b1c1aa9e service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.565089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-05eb850f-cd2d-4539-a16b-d11915d66e63 req-d1f25152-401b-4430-ac39-82e6b1c1aa9e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.565516 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-05eb850f-cd2d-4539-a16b-d11915d66e63 req-d1f25152-401b-4430-ac39-82e6b1c1aa9e service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:41.579098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-05eb850f-cd2d-4539-a16b-d11915d66e63 req-d1f25152-401b-4430-ac39-82e6b1c1aa9e service nova] Creating event network-changed:ff37dcc9-d53c-4424-bdd4-b2400ee2d656 for instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 on hv-cinder-86021 Oct 04 12:14:41.586781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-05eb850f-cd2d-4539-a16b-d11915d66e63 req-d1f25152-401b-4430-ac39-82e6b1c1aa9e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234431 Oct 04 12:14:41.588071 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 743/1000] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:41.593905 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-b24c53ba-75f5-496e-a92f-1dec07c4568a req-ac6143a0-c64b-4fa7-969e-932302430cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa30ac5-5c3d-4440-be77-ec7f7ba22389", "name": "network-vif-deleted", "tag": "faca2777-bf01-421f-9263-4a3fd0fb6283"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:41.604737 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b24c53ba-75f5-496e-a92f-1dec07c4568a req-ac6143a0-c64b-4fa7-969e-932302430cef service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.608466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b24c53ba-75f5-496e-a92f-1dec07c4568a req-ac6143a0-c64b-4fa7-969e-932302430cef service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.608466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-b24c53ba-75f5-496e-a92f-1dec07c4568a req-ac6143a0-c64b-4fa7-969e-932302430cef service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:41.618309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-b24c53ba-75f5-496e-a92f-1dec07c4568a req-ac6143a0-c64b-4fa7-969e-932302430cef service nova] Creating event network-vif-deleted:faca2777-bf01-421f-9263-4a3fd0fb6283 for instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 on hv-cinder-86021 Oct 04 12:14:41.624058 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-b24c53ba-75f5-496e-a92f-1dec07c4568a req-ac6143a0-c64b-4fa7-969e-932302430cef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034881 Oct 04 12:14:41.624796 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 744/1001] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:41.630495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:41.631202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:41.638309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.642993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.642993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:41.642993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.642993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.643617 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:41.728042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:41.737348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-84df7167-4cfd-4f39-8dab-610cb907f426 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1223 microversion: 2.1 time: 0.111288 Oct 04 12:14:41.740364 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 745/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:41 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:41.743793 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f4d4e21e-4754-430b-b8fd-864708b8b4de tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:41.744428 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f4d4e21e-4754-430b-b8fd-864708b8b4de tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:41.822723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f4d4e21e-4754-430b-b8fd-864708b8b4de tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:41.833080 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f4d4e21e-4754-430b-b8fd-864708b8b4de tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1218 microversion: 2.1 time: 0.093682 Oct 04 12:14:41.835140 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 746/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:41 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:41.840435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:41.840435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:41.847775 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.848321 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.848762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:41.849536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:41.849949 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:41.850412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:42.044086 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:42.054885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:42.057085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:42.058714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e09a885c-397f-4137-9e05-d713e89fd854 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.223743 Oct 04 12:14:42.059606 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 747/1004] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:41 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:14:42.773531 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:42.775554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:42.788333 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:42.790896 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:42.790896 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:42.793119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:42.797672 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:42.799231 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:42.857752 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:42.858323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:42.859015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:42.859693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lazy-loading 'fault' on Instance uuid 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:14:42.943731 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:42.958637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9b8ebf51-3455-4886-90b1-846c7d8eca36 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 200 len: 1228 microversion: 2.1 time: 0.189630 Oct 04 12:14:42.972415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 748/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:42 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 1228 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:42.972415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:42.972415 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:42.982585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:42.987137 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:42.987137 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:42.987137 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:42.987137 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:42.987825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:43.067964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:43.078319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-782f35ac-0cc5-4735-9c00-e3690ffcf1eb tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1214 microversion: 2.1 time: 0.116622 Oct 04 12:14:43.079234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 749/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:42 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:43.092342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:43.093661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:43.106409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:43.107483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:43.108339 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:43.109718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:43.110438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:43.111002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:43.346199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:43.356780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:43.358476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:43.359770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-dba69790-96ed-4b1e-ae1a-e431602566f9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.275650 Oct 04 12:14:43.360462 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 750/1007] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:43 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:43.992709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:43.993483 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 2aa30ac5-5c3d-4440-be77-ec7f7ba22389] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:44.002596 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:44.003436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:44.004065 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:44.005146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:44.005784 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:44.006458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:44.025586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] HTTP exception thrown: Instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 could not be found. Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Request method failure captured: Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 HTTP/1.1 Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFwpKaz-RMTzx_rkW00ChzjrFblqZSI_vj9m7jBIo-l2oh0ZEAF3zg2HiCXdtJ3YuiGlHPybeygWtXzGR9XtOQsLr1F4JUtmn8a2vcSEPzTCwmi1XrkYSl-2fkLI_xV8PqKGmRfCsSnKL4pXT2RETlvSBxu_QgbWY5jXB1P0Yh3LqA Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:14:44.028239 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d4da0e2bff704d7a944445d0011a8667", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}] Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 76771369a0df4c5189e42291ebdf9d24 Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 could not be found. Oct 04 12:14:44.031946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '2aa30ac5-5c3d-4440-be77-ec7f7ba22389'} Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 could not be found. Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:14:44.036705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 could not be found. Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 could not be found. Oct 04 12:14:44.039605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:44.041920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Returning 404 to user: Instance 2aa30ac5-5c3d-4440-be77-ec7f7ba22389 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:14:44.041920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ac92c492-261e-4ddf-8e6c-1be8a5e10e2a tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389" status: 404 len: 111 microversion: 2.1 time: 0.042131 Oct 04 12:14:44.041920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 751/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:43 2022] GET /compute/v2.1/servers/2aa30ac5-5c3d-4440-be77-ec7f7ba22389 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:14:44.118669 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:44.119305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:44.127355 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:44.127853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:44.128340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:44.129083 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:44.129542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:44.129999 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:44.209785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:44.220733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-05524b87-44ab-4e41-bc34-f248619c8bda tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1270 microversion: 2.1 time: 0.105884 Oct 04 12:14:44.221553 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 752/1009] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:44 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:44.400486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:44.401271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:44.409122 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:44.409829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:44.410554 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:44.411570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:44.412405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:44.413099 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:44.608042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:44.619492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:44.623002 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:44.625218 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3e90f068-f389-497b-9c60-43082b0a5921 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.229872 Oct 04 12:14:44.626381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 753/1010] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:44 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:45.259929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:45.260887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:45.270828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:45.271623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:45.272341 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:45.273392 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:45.274064 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:45.274660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:45.369297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:45.380744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b952cdae-ec70-4e1f-9bf6-f35da06b7f48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1276 microversion: 2.1 time: 0.125806 Oct 04 12:14:45.381772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 754/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:45 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:45.660878 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:45.661930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:45.671882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:45.672835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:45.673574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:45.674623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:45.675381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:45.675811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:45.694060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:46.252449 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:46.262200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:46.263689 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:46.264897 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c0bb0c9a-1401-4618-a6c7-fa00a0cf2c1c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.611777 Oct 04 12:14:46.265528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 755/1012] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:45 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:14:46.346487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-d3018fe9-6e4d-46bd-8cf4-3c6115d72b3a req-66e4dddb-625d-4292-9aee-a9a2222b1ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53adef1b-9c39-4311-9718-5a32a60b9bc5", "name": "network-vif-plugged", "status": "completed", "tag": "ff37dcc9-d53c-4424-bdd4-b2400ee2d656"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:46.366867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d3018fe9-6e4d-46bd-8cf4-3c6115d72b3a req-66e4dddb-625d-4292-9aee-a9a2222b1ce2 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:46.367479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d3018fe9-6e4d-46bd-8cf4-3c6115d72b3a req-66e4dddb-625d-4292-9aee-a9a2222b1ce2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:46.368040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d3018fe9-6e4d-46bd-8cf4-3c6115d72b3a req-66e4dddb-625d-4292-9aee-a9a2222b1ce2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:46.390478 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-d3018fe9-6e4d-46bd-8cf4-3c6115d72b3a req-66e4dddb-625d-4292-9aee-a9a2222b1ce2 service nova] Creating event network-vif-plugged:ff37dcc9-d53c-4424-bdd4-b2400ee2d656 for instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 on hv-cinder-86021 Oct 04 12:14:46.396831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-d3018fe9-6e4d-46bd-8cf4-3c6115d72b3a req-66e4dddb-625d-4292-9aee-a9a2222b1ce2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129873 Oct 04 12:14:46.397458 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 756/1013] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:46.410255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:46.410255 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:46.415992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:46.423398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:46.423398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:46.423398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:46.423398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:46.424076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:46.744744 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:46.755373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-0c4961eb-bb10-42d2-a97a-e3561b01dc2a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.352036 Oct 04 12:14:46.756742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 757/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:46 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:47.311963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:47.312903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:47.320271 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:47.320778 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:47.321230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:47.321974 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:47.322438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:47.322865 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:47.840809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:47.850718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:47.852245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:47.853420 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-bb02a6ba-6171-47da-9921-386f37c82268 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1407 microversion: 2.20 time: 0.545872 Oct 04 12:14:47.853981 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 758/1015] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:47 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:14:47.873801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:47.875153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:47.886801 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:47.887680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:47.888487 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:47.889671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:47.890488 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:47.891240 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:48.139899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:48.149252 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2cc57352-ae4c-45db-bd01-823a8e485dca tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.282928 Oct 04 12:14:48.149857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 759/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:47 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:48.237753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-d4d8fe25-f518-4291-b1b8-c63f83055081 req-8154b611-b1fa-4629-9eed-e612b237516d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c95d11a-414f-4de8-bbe8-80db02c4eba2", "tag": "e2e73f55-9280-409b-b6a0-32606eb2df48"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:48.257875 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d4d8fe25-f518-4291-b1b8-c63f83055081 req-8154b611-b1fa-4629-9eed-e612b237516d service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:48.258623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d4d8fe25-f518-4291-b1b8-c63f83055081 req-8154b611-b1fa-4629-9eed-e612b237516d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:48.259210 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d4d8fe25-f518-4291-b1b8-c63f83055081 req-8154b611-b1fa-4629-9eed-e612b237516d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:48.276693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-d4d8fe25-f518-4291-b1b8-c63f83055081 req-8154b611-b1fa-4629-9eed-e612b237516d service nova] Creating event network-changed:e2e73f55-9280-409b-b6a0-32606eb2df48 for instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 on hv-cinder-86021 Oct 04 12:14:48.283535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-d4d8fe25-f518-4291-b1b8-c63f83055081 req-8154b611-b1fa-4629-9eed-e612b237516d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050595 Oct 04 12:14:48.284841 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 760/1017] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:14:48.895598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:48.897155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:48.906993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:48.908034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:48.909013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:48.910106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:48.915382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:48.915382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:49.174948 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:49.191437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:49.208492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:49.208492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4a03b143-2063-4be7-90d7-ede0f7830008 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1598 microversion: 2.20 time: 0.316366 Oct 04 12:14:49.208492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 761/1018] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:14:48 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1598 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:14:49.208492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:49.209120 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:49.227290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:49.228266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:49.228943 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:49.229880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:49.230903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:49.231609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:49.268139 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:14:49.837155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9b113830-7c1c-4ba1-833b-eb92775aa115 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "DELETE /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 204 len: 0 microversion: 2.1 time: 0.638714 Oct 04 12:14:49.843183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 762/1019] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:14:49 2022] DELETE /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 12:14:49.847259 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:49.848157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:49.852696 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:49.858985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:49.859670 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:49.860305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:49.861797 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:49.862816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:49.863393 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.051331 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:50.060435 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b1171156-c512-4763-9a37-3caa2bcd1902 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.220640 Oct 04 12:14:50.068354 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 763/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:49 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:50.068354 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:50.068354 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:50.074318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:50.074812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:50.075250 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.075994 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:50.076485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:50.076913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.167486 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e549b653-5dc1-4caa-9585-fd12cc69c6a5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105016 Oct 04 12:14:50.168326 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 764/1021] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Oct 4 12:14:50 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 12:14:50.174289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:50.175156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:50.182919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:50.183522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:50.184067 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.184995 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:50.185656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:50.186143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.493293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:50.507131 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d077dca6-516c-4b30-9554-9341ba414e86 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1576 microversion: 2.1 time: 0.336782 Oct 04 12:14:50.508142 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 765/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:50 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1576 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:50.517633 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-d6f15427-dff8-4651-b5ea-17d21ebb5324 req-5ae3ed7c-e1dc-4c8f-af64-b6dfeffa2a5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11aa9f19-db2a-476a-9a38-848192aa612c", "tag": "853bd174-966e-4864-a482-32138d73cdea"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:50.536097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d6f15427-dff8-4651-b5ea-17d21ebb5324 req-5ae3ed7c-e1dc-4c8f-af64-b6dfeffa2a5f service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:50.537026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d6f15427-dff8-4651-b5ea-17d21ebb5324 req-5ae3ed7c-e1dc-4c8f-af64-b6dfeffa2a5f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:50.537809 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-d6f15427-dff8-4651-b5ea-17d21ebb5324 req-5ae3ed7c-e1dc-4c8f-af64-b6dfeffa2a5f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:50.562024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-d6f15427-dff8-4651-b5ea-17d21ebb5324 req-5ae3ed7c-e1dc-4c8f-af64-b6dfeffa2a5f service nova] Creating event network-changed:853bd174-966e-4864-a482-32138d73cdea for instance 11aa9f19-db2a-476a-9a38-848192aa612c on hv-cinder-86021 Oct 04 12:14:50.572215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-d6f15427-dff8-4651-b5ea-17d21ebb5324 req-5ae3ed7c-e1dc-4c8f-af64-b6dfeffa2a5f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061859 Oct 04 12:14:50.573401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 766/1023] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:51.093903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:51.094955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:51.102746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:51.103251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:51.103700 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:51.104480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:51.104944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:51.105379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:51.165434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:51.580570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:51.593802 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2dd326b7-2ab0-4b86-928a-547577721f62 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.505390 Oct 04 12:14:51.597314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 767/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:51 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:51.601946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:51.602725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:51.614406 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:51.614985 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:51.615785 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:51.616561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:51.617133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:51.617798 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:51.826481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell0:SELECT=8 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:51.865993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:51.882549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1d4275b1-0478-415d-99fd-8377f9ad36a1 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1576 microversion: 2.1 time: 0.285378 Oct 04 12:14:51.883604 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 768/1025] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:51 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:52.633024 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-9db2bead-4490-4524-b7eb-cbd05be582ef req-be74be02-0a75-469e-8bbb-6a037d63bcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53adef1b-9c39-4311-9718-5a32a60b9bc5", "tag": "ff37dcc9-d53c-4424-bdd4-b2400ee2d656"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:52.648761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9db2bead-4490-4524-b7eb-cbd05be582ef req-be74be02-0a75-469e-8bbb-6a037d63bcf2 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:52.649368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9db2bead-4490-4524-b7eb-cbd05be582ef req-be74be02-0a75-469e-8bbb-6a037d63bcf2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:52.649989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9db2bead-4490-4524-b7eb-cbd05be582ef req-be74be02-0a75-469e-8bbb-6a037d63bcf2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:52.663484 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-9db2bead-4490-4524-b7eb-cbd05be582ef req-be74be02-0a75-469e-8bbb-6a037d63bcf2 service nova] Creating event network-changed:ff37dcc9-d53c-4424-bdd4-b2400ee2d656 for instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 on hv-cinder-86021 Oct 04 12:14:52.671550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-9db2bead-4490-4524-b7eb-cbd05be582ef req-be74be02-0a75-469e-8bbb-6a037d63bcf2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045232 Oct 04 12:14:52.672662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 769/1026] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:14:52.679390 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:52.680543 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:52.687901 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:52.689992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:52.690748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:52.693820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:52.694783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:52.695457 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:53.072196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:53.092491 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8de49fa2-83a6-4318-abcb-afd0ae8cd9b5 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.409094 Oct 04 12:14:53.096555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 770/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:52 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:53.102156 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:53.104060 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:53.111370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:53.112056 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:53.113006 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:53.114113 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:53.114698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:53.115253 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:53.377835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:53.398986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-cece965b-9c6c-47cd-b0bd-30939969a944 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1576 microversion: 2.1 time: 0.300549 Oct 04 12:14:53.400284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 771/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:53 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1576 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:53.810323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-9deb0da2-242e-4b17-ad22-f4eb5bdd6e6f req-f22aed1d-91cf-46be-923e-88f8da4531f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11aa9f19-db2a-476a-9a38-848192aa612c", "name": "network-vif-deleted", "tag": "853bd174-966e-4864-a482-32138d73cdea"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:53.837843 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9deb0da2-242e-4b17-ad22-f4eb5bdd6e6f req-f22aed1d-91cf-46be-923e-88f8da4531f2 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:53.838766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9deb0da2-242e-4b17-ad22-f4eb5bdd6e6f req-f22aed1d-91cf-46be-923e-88f8da4531f2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:53.839542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-9deb0da2-242e-4b17-ad22-f4eb5bdd6e6f req-f22aed1d-91cf-46be-923e-88f8da4531f2 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:53.864154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-9deb0da2-242e-4b17-ad22-f4eb5bdd6e6f req-f22aed1d-91cf-46be-923e-88f8da4531f2 service nova] Creating event network-vif-deleted:853bd174-966e-4864-a482-32138d73cdea for instance 11aa9f19-db2a-476a-9a38-848192aa612c on hv-cinder-86021 Oct 04 12:14:53.872876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-9deb0da2-242e-4b17-ad22-f4eb5bdd6e6f req-f22aed1d-91cf-46be-923e-88f8da4531f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075567 Oct 04 12:14:53.874268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 772/1029] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:14:54.112751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:54.113476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:54.120498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:54.121028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:54.121730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:54.122552 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:54.122947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:54.123379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:54.339834 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:54.344082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:14:54.350571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-26ca8fe7-a895-4d29-9883-7d42247ee436 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.242797 Oct 04 12:14:54.351437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 773/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:54 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:54.442688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:54.443509 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:54.459520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:54.459520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:54.459520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:54.459520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:54.460368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:54.460621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:54.563757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:54.579739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-503900b2-e2f7-4d6d-aa3b-a25e6580e7b3 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1224 microversion: 2.1 time: 0.141895 Oct 04 12:14:54.581233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 774/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:54 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:14:55.388004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:55.388873 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:55.397493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:55.397984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:55.398423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:55.399154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:55.399620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:55.400047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:55.569493 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:55.581992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1de94b33-c07c-49a0-8636-a323a9aeeb69 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.198811 Oct 04 12:14:55.582769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 775/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:55 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:55.617501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:55.618124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:55.624963 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:55.625452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:55.626433 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:55.627401 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:55.627887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:55.628308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:55.665368 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:55.665849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:55.666285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:55.666754 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lazy-loading 'fault' on Instance uuid 11aa9f19-db2a-476a-9a38-848192aa612c {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:14:55.737238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76771369a0df4c5189e42291ebdf9d24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4da0e2bff704d7a944445d0011a8667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:55.746258 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-d7d08680-186f-4e35-b94e-3ff0b484c658 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 200 len: 1183 microversion: 2.1 time: 0.132601 Oct 04 12:14:55.747032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 776/1033] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:55 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 1183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:56.014482 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-123ccab3-ef89-41d0-a71a-33ade2f50087 req-5dac652c-372b-4f87-87af-ce45c4830507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c95d11a-414f-4de8-bbe8-80db02c4eba2", "name": "network-vif-plugged", "status": "completed", "tag": "e2e73f55-9280-409b-b6a0-32606eb2df48"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:56.026237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-123ccab3-ef89-41d0-a71a-33ade2f50087 req-5dac652c-372b-4f87-87af-ce45c4830507 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:56.026730 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-123ccab3-ef89-41d0-a71a-33ade2f50087 req-5dac652c-372b-4f87-87af-ce45c4830507 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:56.027161 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-123ccab3-ef89-41d0-a71a-33ade2f50087 req-5dac652c-372b-4f87-87af-ce45c4830507 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:56.040103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-123ccab3-ef89-41d0-a71a-33ade2f50087 req-5dac652c-372b-4f87-87af-ce45c4830507 service nova] Creating event network-vif-plugged:e2e73f55-9280-409b-b6a0-32606eb2df48 for instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 on hv-cinder-86021 Oct 04 12:14:56.046251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-123ccab3-ef89-41d0-a71a-33ade2f50087 req-5dac652c-372b-4f87-87af-ce45c4830507 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036167 Oct 04 12:14:56.046871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 777/1034] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:14:56.609805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:56.611126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:56.617470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:56.617950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:56.618379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:56.619165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:56.619619 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:56.620039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:56.773742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:56.782550 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1a771617-4112-409a-aaf7-3d6860c783a2 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.177492 Oct 04 12:14:56.783337 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 778/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:56 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:56.792533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:56.793751 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: 11aa9f19-db2a-476a-9a38-848192aa612c] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:56.806206 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:56.807090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:56.807879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:56.809452 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:56.810461 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:56.811244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:56.828266 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] HTTP exception thrown: Instance 11aa9f19-db2a-476a-9a38-848192aa612c could not be found. Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Request method failure captured: Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c HTTP/1.1 Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFwpKaz-RMTzx_rkW00ChzjrFblqZSI_vj9m7jBIo-l2oh0ZEAF3zg2HiCXdtJ3YuiGlHPybeygWtXzGR9XtOQsLr1F4JUtmn8a2vcSEPzTCwmi1XrkYSl-2fkLI_xV8PqKGmRfCsSnKL4pXT2RETlvSBxu_QgbWY5jXB1P0Yh3LqA Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:14:56.830440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d4da0e2bff704d7a944445d0011a8667", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}] Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 76771369a0df4c5189e42291ebdf9d24 Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 11aa9f19-db2a-476a-9a38-848192aa612c could not be found. Oct 04 12:14:56.832940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '11aa9f19-db2a-476a-9a38-848192aa612c'} Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11aa9f19-db2a-476a-9a38-848192aa612c could not be found. Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:14:56.834485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11aa9f19-db2a-476a-9a38-848192aa612c could not be found. Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11aa9f19-db2a-476a-9a38-848192aa612c could not be found. Oct 04 12:14:56.836889 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:56.839199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Returning 404 to user: Instance 11aa9f19-db2a-476a-9a38-848192aa612c could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:14:56.839199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7757eb30-bffd-4084-be6d-e41e7fabb076 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c" status: 404 len: 111 microversion: 2.1 time: 0.047223 Oct 04 12:14:56.839199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 779/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:56 2022] GET /compute/v2.1/servers/11aa9f19-db2a-476a-9a38-848192aa612c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:14:57.436880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:57.437412 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:57.444959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.445447 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.445888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.446598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.447054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.447475 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.464404 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] HTTP exception thrown: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Request method failure captured: Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 HTTP/1.1 Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFwpKaz-RMTzx_rkW00ChzjrFblqZSI_vj9m7jBIo-l2oh0ZEAF3zg2HiCXdtJ3YuiGlHPybeygWtXzGR9XtOQsLr1F4JUtmn8a2vcSEPzTCwmi1XrkYSl-2fkLI_xV8PqKGmRfCsSnKL4pXT2RETlvSBxu_QgbWY5jXB1P0Yh3LqA Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:14:57.466100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d4da0e2bff704d7a944445d0011a8667", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}] Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 76771369a0df4c5189e42291ebdf9d24 Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.468232 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'fe5b93b6-ec32-4534-b51b-15e8eeb734d1'} Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:14:57.469503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.472098 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.474575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Returning 404 to user: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:14:57.474575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-dc982049-d49f-47e2-8ee2-4da57da22ba5 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "DELETE /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 404 len: 111 microversion: 2.1 time: 0.035105 Oct 04 12:14:57.474575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 780/1037] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:14:57 2022] DELETE /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:14:57.479398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:57.480092 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] [instance: fe5b93b6-ec32-4534-b51b-15e8eeb734d1] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:57.487437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.487938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.488409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.489133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.489589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.490047 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.505972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] HTTP exception thrown: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Request method failure captured: Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 HTTP/1.1 Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCFwpKaz-RMTzx_rkW00ChzjrFblqZSI_vj9m7jBIo-l2oh0ZEAF3zg2HiCXdtJ3YuiGlHPybeygWtXzGR9XtOQsLr1F4JUtmn8a2vcSEPzTCwmi1XrkYSl-2fkLI_xV8PqKGmRfCsSnKL4pXT2RETlvSBxu_QgbWY5jXB1P0Yh3LqA Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:14:57.507585 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_d4da0e2bff704d7a944445d0011a8667", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/d4da0e2bff704d7a944445d0011a8667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/d4da0e2bff704d7a944445d0011a8667"}]}] Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: d4da0e2bff704d7a944445d0011a8667 Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-TestVolumeBootPattern-1280166139 Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 76771369a0df4c5189e42291ebdf9d24 Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-TestVolumeBootPattern-1280166139-project Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.510725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'fe5b93b6-ec32-4534-b51b-15e8eeb734d1'} Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:14:57.512101 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. Oct 04 12:14:57.514515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:14:57.516557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Returning 404 to user: Instance fe5b93b6-ec32-4534-b51b-15e8eeb734d1 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:14:57.516557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-619d66ae-af56-4f45-b10c-285dd314e5dc tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1" status: 404 len: 111 microversion: 2.1 time: 0.034384 Oct 04 12:14:57.516557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 781/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:57 2022] GET /compute/v2.1/servers/fe5b93b6-ec32-4534-b51b-15e8eeb734d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:14:57.824437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:57.825399 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:57.837199 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.838039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.838791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.839993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:57.840818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:57.841571 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:57.995345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:58.004749 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4f686ef8-4afb-4bf3-b5b6-b8f1e7593e50 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1318 microversion: 2.1 time: 0.187245 Oct 04 12:14:58.005348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 782/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:57 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:59.033612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:59.034703 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:59.046877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:59.048294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:59.048883 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:59.049768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:59.050333 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:59.050852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:59.229385 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:14:59.239187 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-75cf3c89-8cc5-40d4-aff7-3f0a2f03a97a tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1506 microversion: 2.1 time: 0.213391 Oct 04 12:14:59.239782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 783/1040] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:14:59 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:14:59.247441 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-483a6212-cdd0-43e1-9503-a40fd7ee9837 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] Calling method '.version_select at 0x7f10c701c430>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:14:59.339695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-483a6212-cdd0-43e1-9503-a40fd7ee9837 tempest-TestVolumeBootPattern-1280166139 tempest-TestVolumeBootPattern-1280166139-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-25342910" status: 202 len: 0 microversion: 2.1 time: 0.098770 Oct 04 12:14:59.340330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 784/1041] 10.222.0.15 () {58 vars in 1257 bytes} [Tue Oct 4 12:14:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-25342910 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 12:14:59.346145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eec4c83-c18a-4396-8aed-8635bd8dcfdc", "device": "/dev/sdb"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:14:59.348872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:14:59.355956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:59.360926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:59.360926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:14:59.360926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:14:59.360926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:14:59.361572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:00.260850 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-49e3ba32-5041-490c-bcc3-310dfcef3c31 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "POST /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918977 Oct 04 12:15:00.262108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 785/1042] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Oct 4 12:14:59 2022] POST /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 12:15:23.182815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:23.183848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:23.188818 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:23.189450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:23.196937 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:23.197512 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:23.198112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:23.198829 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:23.200005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:23.200005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:23.300712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lazy-loading 'services' on Instance uuid 9c95d11a-414f-4de8-bbe8-80db02c4eba2 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:15:23.544147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5613eec3-19a9-443c-b041-5c14f4835b48 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2/os-volume_attachments/0eec4c83-c18a-4396-8aed-8635bd8dcfdc" status: 202 len: 0 microversion: 2.1 time: 0.362888 Oct 04 12:15:23.544780 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 786/1043] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Oct 4 12:15:23 2022] DELETE /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2/os-volume_attachments/0eec4c83-c18a-4396-8aed-8635bd8dcfdc => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 12:15:25.757260 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:25.757992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:25.766540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:25.767039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:25.767569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:25.768877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:25.768877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:25.769196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:25.798440 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:15:26.097782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-3ad3381b-c5a3-4fc7-bef0-ceef0f18d4c9 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 204 len: 0 microversion: 2.1 time: 0.345587 Oct 04 12:15:26.098397 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 787/1044] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Oct 4 12:15:25 2022] DELETE /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:15:26.107886 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:26.108705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:26.115721 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:26.116238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:26.116683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:26.117538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:26.118026 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:26.118453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:26.284106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:26.293291 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-68ffd50b-a38e-480d-8c60-94b92317c883 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1512 microversion: 2.1 time: 0.189653 Oct 04 12:15:26.293890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 788/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:26 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:15:27.317470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:27.318309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:27.325381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:27.325873 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:27.326313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:27.327022 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:27.327477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:27.328546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:27.494442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:27.504150 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7494c85b-57b6-491a-a0b2-8a958e3635b0 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1512 microversion: 2.1 time: 0.190630 Oct 04 12:15:27.504791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 789/1046] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:27 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:15:28.533540 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:28.534702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:28.547097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:28.548059 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:28.548857 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:28.550108 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:28.550925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:28.551668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:28.741129 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:28.756572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-805a8f07-c2e2-48a9-8f64-0faa59bc7f4e tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1512 microversion: 2.1 time: 0.230916 Oct 04 12:15:28.757900 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 790/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:28 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:15:29.091329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-637de5b4-6e1e-4224-8809-c4ec9e8da616 req-2dadc7c7-0ac5-424a-abc9-504d6e86504d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c95d11a-414f-4de8-bbe8-80db02c4eba2", "name": "network-vif-deleted", "tag": "e2e73f55-9280-409b-b6a0-32606eb2df48"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:15:29.103116 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-637de5b4-6e1e-4224-8809-c4ec9e8da616 req-2dadc7c7-0ac5-424a-abc9-504d6e86504d service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:29.109692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-637de5b4-6e1e-4224-8809-c4ec9e8da616 req-2dadc7c7-0ac5-424a-abc9-504d6e86504d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:29.109692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-637de5b4-6e1e-4224-8809-c4ec9e8da616 req-2dadc7c7-0ac5-424a-abc9-504d6e86504d service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:29.117986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-637de5b4-6e1e-4224-8809-c4ec9e8da616 req-2dadc7c7-0ac5-424a-abc9-504d6e86504d service nova] Creating event network-vif-deleted:e2e73f55-9280-409b-b6a0-32606eb2df48 for instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 on hv-cinder-86021 Oct 04 12:15:29.124032 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-637de5b4-6e1e-4224-8809-c4ec9e8da616 req-2dadc7c7-0ac5-424a-abc9-504d6e86504d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036476 Oct 04 12:15:29.124815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 791/1048] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:15:29.801090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:29.802333 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:29.811492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:29.813085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:29.813799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:29.814599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:29.815349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:29.816132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:29.860742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:29.861226 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:29.861678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:29.862131 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lazy-loading 'fault' on Instance uuid 9c95d11a-414f-4de8-bbe8-80db02c4eba2 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:15:29.911388 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf86d2ca271e4828ba8ce6cb78b2c2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ef9812a3194dcb9c88e284be7e3982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:29.919968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-902c4afb-018a-45bd-a143-3bb9672e6852 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 200 len: 1308 microversion: 2.1 time: 0.129143 Oct 04 12:15:29.920610 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 792/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:29 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 12:15:30.946033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:30.946907 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] [instance: 9c95d11a-414f-4de8-bbe8-80db02c4eba2] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:30.955171 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:30.955660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:30.956096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:30.956856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:30.957316 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:30.957735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:30.972770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] HTTP exception thrown: Instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 could not be found. Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Request method failure captured: Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 HTTP/1.1 Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCNFnGr5g-pVGSoOcgxT80btEUHS5pn59AYg7s2bnHoT5EDvztUkqbmZv2KUO9_ythduMsSnbeXcaN7mlhYtxfPDEbKCP6u5nWVf_QwddLPWrVxdQevmxXMdpBjXu0Z7aTFOnqpZvub102dsOh6xEuYzR123N6RArR-aPyofy3mclG8 Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 23ef9812a3194dcb9c88e284be7e3982 Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1924315345 Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:15:30.974445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_23ef9812a3194dcb9c88e284be7e3982", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23ef9812a3194dcb9c88e284be7e3982"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/23ef9812a3194dcb9c88e284be7e3982"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/23ef9812a3194dcb9c88e284be7e3982"}]}] Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesSnapshotTestJSON-1924315345 Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 23ef9812a3194dcb9c88e284be7e3982 Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1924315345 Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesSnapshotTestJSON-1924315345-project Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: cf86d2ca271e4828ba8ce6cb78b2c2b4 Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesSnapshotTestJSON-1924315345-project Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 could not be found. Oct 04 12:15:30.977018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '9c95d11a-414f-4de8-bbe8-80db02c4eba2'} Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 could not be found. Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:15:30.977993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 could not be found. Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 could not be found. Oct 04 12:15:30.980546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:15:30.982542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] Returning 404 to user: Instance 9c95d11a-414f-4de8-bbe8-80db02c4eba2 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:15:30.982542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-83f79bed-a354-4a6b-bbea-2b11a80e7f67 tempest-VolumesSnapshotTestJSON-1924315345 tempest-VolumesSnapshotTestJSON-1924315345-project] 10.222.0.15 "GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2" status: 404 len: 111 microversion: 2.1 time: 0.034261 Oct 04 12:15:30.982542 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 793/1050] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Oct 4 12:15:30 2022] GET /compute/v2.1/servers/9c95d11a-414f-4de8-bbe8-80db02c4eba2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:15:39.045663 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:39.047205 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:39.054115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:39.054609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:39.055052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:39.056053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:39.056445 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:39.056786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:39.086888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-868eb980-b937-49c6-a9af-4111f5d23075 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/ips" status: 200 len: 151 microversion: 2.20 time: 0.045630 Oct 04 12:15:39.087481 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 794/1051] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Oct 4 12:15:39 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:15:41.902947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:15:41.903766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:41.911382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:41.911920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:41.912597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:41.915313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:41.915313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:41.915313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:41.944935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lazy-loading 'flavor' on Instance uuid 53adef1b-9c39-4311-9718-5a32a60b9bc5 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:15:42.711562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-592f7fc8-ed39-46f7-926f-0ea977ea9ade tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/action" status: 202 len: 0 microversion: 2.20 time: 0.812602 Oct 04 12:15:42.712195 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 795/1052] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 4 12:15:41 2022] POST /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:15:42.721294 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:42.722010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:42.729235 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:42.729733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:42.730184 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:42.730920 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:42.731373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:42.731794 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:42.910094 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:42.919869 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:42.921616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:42.923114 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-df14e8a2-796b-4fcb-aef9-2d89d94e124b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.206153 Oct 04 12:15:42.923766 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 796/1053] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:42 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:43.953947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:43.954867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:43.963143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:43.965923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:43.965923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:43.965923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:43.965923 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:43.966497 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:44.116102 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:44.125702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:44.128650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:44.128962 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-40313a4f-2000-48fd-b3cb-6fa1e60bbd2d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.181127 Oct 04 12:15:44.129564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 797/1054] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:43 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:45.156756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:45.157474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:45.165267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:45.165925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:45.166476 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:45.167449 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:45.168010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:45.168587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:45.338933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:45.348516 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:45.349950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:45.351132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ead6162a-94bb-4d28-96c6-b933a026ad92 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.198971 Oct 04 12:15:45.351756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 798/1055] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:45 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:46.377357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:46.378115 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:46.385609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:46.386065 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:46.386528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:46.387262 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:46.387748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:46.388274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:46.410980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:46.538913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:46.552665 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:46.555719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:46.558012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b8137b79-1dbc-4c0e-a37f-eabcd3b5ecc8 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.184972 Oct 04 12:15:46.559009 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 799/1056] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:46 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:47.585347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:47.586071 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:47.593710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:47.594191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:47.594622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:47.595325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:47.595830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:47.596423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:47.744204 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:47.753812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:47.755495 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:47.756884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4901b8b9-f16f-4e1e-8a9b-1937ad547c25 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.176269 Oct 04 12:15:47.757545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 800/1057] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:47 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:48.783816 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:48.784549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:48.791921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:48.792438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:48.792881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:48.793597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:48.794097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:48.794525 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:48.968370 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:48.980439 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:48.984959 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:48.985833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-17a88f97-018d-4c09-bd50-443d94bc2c3b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.206461 Oct 04 12:15:48.986764 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 801/1058] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:48 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:50.015410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:50.016528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:50.025680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:50.026200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:50.026710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:50.027442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:50.027929 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:50.028503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:50.220535 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:50.229940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:50.236656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:50.236656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e227f8f6-2469-4079-b97e-2c0cefec772f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.225507 Oct 04 12:15:50.236656 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 802/1059] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:50 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:51.449866 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:51.455544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:51.456587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:51.457075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:51.457514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:51.458217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:51.458789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:51.459220 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:51.601134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:51.609871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:51.611285 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:51.612978 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-394fb1fb-be04-4cc1-a454-63b3816b39db tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.356227 Oct 04 12:15:51.613121 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 803/1060] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:51 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:52.638087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:52.639622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:52.646492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:52.647074 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:52.647560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:52.648375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:52.648967 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:52.649463 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:52.822153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:52.833264 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:52.836215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:52.838436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4530583b-bd4a-4b21-9dd7-d7b84162499b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.204093 Oct 04 12:15:52.839480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 804/1061] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:52 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:53.882405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:53.883196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:53.890874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:53.891361 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:53.891817 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:53.892549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:53.892992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:53.893413 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:54.044712 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:54.054038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:54.055781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:54.057172 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b85141cb-1fbe-47e8-971b-8c8477b310ab tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.178877 Oct 04 12:15:54.057849 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 805/1062] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:53 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:55.086515 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:55.087477 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:55.100852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:55.101793 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:55.102859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:55.104238 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:55.105124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:55.105872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:55.284957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:55.299530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:55.302293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:55.304576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-723c25b2-dd77-4568-97c3-65e538eefed3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.223918 Oct 04 12:15:55.306038 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 806/1063] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:55 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:56.337003 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:56.337833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:56.340768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:15:56.346982 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:56.347625 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:56.348302 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:56.348934 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:56.349455 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:56.349922 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:56.506464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:56.515927 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:56.517573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:56.518882 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-8759f177-41f1-4f39-8c25-77bf0cd1a210 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.186455 Oct 04 12:15:56.519469 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 807/1064] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:56 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:57.545681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:57.546517 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:57.553885 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:57.554423 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:57.554902 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:57.555698 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:57.556242 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:57.556683 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:57.706344 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:57.718799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:57.720623 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:57.722214 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-9f31566a-9ee0-411c-8055-e1281e07b00b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.181512 Oct 04 12:15:57.722993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 808/1065] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:57 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:58.751220 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:58.751986 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:58.760075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:58.760685 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:58.761167 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:58.761964 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:58.762502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:58.763054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:58.919709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:58.930198 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:58.932157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:15:58.933759 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f9a39131-c929-4594-ae8d-55f865e61a1f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.187655 Oct 04 12:15:58.934526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 809/1066] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:58 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:15:59.967268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:15:59.968557 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:15:59.979968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:59.980870 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:59.981676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:15:59.983489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:15:59.984288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:15:59.985021 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:00.141573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:00.151126 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:00.152738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:00.153988 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-da574660-411b-4acf-81fc-c9090b4b07b4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.194745 Oct 04 12:16:00.155104 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 810/1067] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:15:59 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:01.182143 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:01.182904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:01.191170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:01.191790 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:01.192417 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:01.201805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:01.201805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:01.201805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:01.385418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:01.396118 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:01.397968 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:01.399419 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ae4b83e5-9cee-4178-9a84-44b47492e213 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.221468 Oct 04 12:16:01.400526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 811/1068] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:01 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:02.438811 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:02.439545 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:02.446587 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:02.447087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:02.447567 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:02.448363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:02.448830 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:02.449261 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:02.599734 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:02.608688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:02.610146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:02.611405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-45612601-e787-43a4-8604-3a377c504c2e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.176828 Oct 04 12:16:02.611989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 812/1069] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:02 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:03.638342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:03.639589 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:03.646288 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:03.646828 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:03.647270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:03.648016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:03.648507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:03.648935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:03.810183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:03.819025 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:03.820530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:03.821760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b07771cb-4164-42a8-b322-e416ca3680f5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1744 microversion: 2.20 time: 0.188159 Oct 04 12:16:03.822348 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 813/1070] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:03 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:04.847772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:04.848651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:04.855234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:04.855843 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:04.856438 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:04.857740 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:04.858185 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:04.858601 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:05.006788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:05.015940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:05.017451 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:05.018661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ea9c6cbf-b14c-45a7-baa2-921aeee53f16 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1744 microversion: 2.20 time: 0.175014 Oct 04 12:16:05.019237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 814/1071] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:04 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:06.044100 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:06.045771 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:06.052940 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:06.053574 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:06.054147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:06.054957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:06.055514 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:06.056042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:06.205014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:06.221675 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:06.224864 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:06.227153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f5a91401-b60b-47bf-92c2-6be6dcd5430e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1744 microversion: 2.20 time: 0.186894 Oct 04 12:16:06.228311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 815/1072] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:06 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:07.269924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:07.270687 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:07.277946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:07.278431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:07.279984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:07.280343 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:07.280772 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:07.281190 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:07.285893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=100 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:07.461177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:07.472015 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:07.473658 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:07.475213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5a52061c-5246-463f-94a2-e12c5ae6d603 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.209499 Oct 04 12:16:07.476499 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 816/1073] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:07 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:08.416569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-e782a57e-fd31-40cc-88be-736870c72a60 req-2a368c6a-50f4-42d3-b9dc-7c59885c70f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53adef1b-9c39-4311-9718-5a32a60b9bc5", "name": "network-vif-plugged", "status": "completed", "tag": "ff37dcc9-d53c-4424-bdd4-b2400ee2d656"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:16:08.446410 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e782a57e-fd31-40cc-88be-736870c72a60 req-2a368c6a-50f4-42d3-b9dc-7c59885c70f3 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:08.447329 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e782a57e-fd31-40cc-88be-736870c72a60 req-2a368c6a-50f4-42d3-b9dc-7c59885c70f3 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:08.448382 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-e782a57e-fd31-40cc-88be-736870c72a60 req-2a368c6a-50f4-42d3-b9dc-7c59885c70f3 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:08.474888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-e782a57e-fd31-40cc-88be-736870c72a60 req-2a368c6a-50f4-42d3-b9dc-7c59885c70f3 service nova] Creating event network-vif-plugged:ff37dcc9-d53c-4424-bdd4-b2400ee2d656 for instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 on hv-cinder-86021 Oct 04 12:16:08.485318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-e782a57e-fd31-40cc-88be-736870c72a60 req-2a368c6a-50f4-42d3-b9dc-7c59885c70f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075851 Oct 04 12:16:08.486932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 817/1074] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:16:08.525008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:08.525723 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:08.533956 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:08.534806 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:08.535916 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:08.537346 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:08.538562 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:08.539162 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:08.771286 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:08.781769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:08.783366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:08.785107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7606614a-a386-4917-8bdc-289a12678180 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.265229 Oct 04 12:16:08.786394 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 818/1075] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:08 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:09.819527 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:09.823874 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:09.833478 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:09.834466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:09.835556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:09.836987 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:09.837823 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:09.838783 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:10.259133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:10.276607 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:10.320504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:10.320504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-59dc7a9a-8202-4df0-b815-90acee6f3713 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.472401 Oct 04 12:16:10.320504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 819/1076] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:09 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:11.350710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:11.353282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:11.360791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:11.361349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:11.361928 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:11.362782 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:11.363305 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:11.363994 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:11.530496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:11.540867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:11.542861 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:11.545349 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1f89a615-9423-4430-b75e-7c2013d479eb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.199524 Oct 04 12:16:11.546012 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 820/1077] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:11 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:12.572340 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:12.573980 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:12.586145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:12.587466 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:12.588211 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:12.589196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:12.589877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:12.590524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:12.795722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:12.809812 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:12.811941 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:12.813309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5983962f-012c-4d63-9c2b-ff003bc8f3cd tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.245362 Oct 04 12:16:12.822178 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 821/1078] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:12 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:12.857410 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:16:12.858036 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:16:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:16:13.846528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:13.849165 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:13.860363 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:13.860852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:13.861453 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:13.861993 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:13.862485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:13.862909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:14.084911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:14.103471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:14.105807 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:14.107952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a830338f-94cf-4ae4-acb3-aad480f259a9 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.268921 Oct 04 12:16:14.108770 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 822/1079] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:13 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:15.139573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:15.140735 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:15.152342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:15.153081 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:15.154103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:15.154827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:15.155277 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:15.155709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:15.320660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:15.337039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:15.339957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:15.342776 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-07db8629-b0b6-4b1a-aed8-6c6a153e3fb0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.210007 Oct 04 12:16:15.343978 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 823/1080] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:15 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:16.374443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:16.375668 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:16.391456 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:16.392350 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:16.393157 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:16.394480 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:16.395402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:16.396335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:16.651287 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:16.667141 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:16.669753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:16.671318 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-24ba53f5-20e9-4e24-abea-5de9f47eb3f7 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.304681 Oct 04 12:16:16.672541 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 824/1081] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:16 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:17.707190 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:17.708313 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:17.723095 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:17.723919 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:17.724997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:17.726256 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:17.727030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:17.727760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:17.975082 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:18.007213 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:18.010351 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:18.012693 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-a850bea9-5ab8-4494-b1d0-ddde3c3fd55f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.312140 Oct 04 12:16:18.015220 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 825/1082] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:17 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:19.044570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:19.046921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:19.058808 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:19.060654 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:19.061381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:19.062815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:19.063624 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:19.064345 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:19.249402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:19.265622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:19.269442 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:19.271539 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-16b1cab4-080e-4ccb-922e-519640bca3e5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.235991 Oct 04 12:16:19.280437 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 826/1083] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:19 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:20.303188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:20.303903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:20.311295 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:20.311788 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:20.312417 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:20.313149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:20.313609 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:20.314039 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:20.470569 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:20.479796 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:20.481648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:20.483029 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b81cafba-d529-4de8-ac9f-e56cb1e5eaf2 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1739 microversion: 2.20 time: 0.183880 Oct 04 12:16:20.483681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 827/1084] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:20 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:21.517215 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:21.517925 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:21.525269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:21.525765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:21.526203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:21.526944 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:21.527405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:21.527831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:21.675372 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:21.692036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:21.695128 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:21.697479 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fee1e198-e625-4eb9-b081-22528448a456 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1721 microversion: 2.20 time: 0.184142 Oct 04 12:16:21.698556 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 828/1085] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:21 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:22.741246 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:22.741950 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:22.748996 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:22.749478 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:22.749913 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:22.750621 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:22.751245 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:22.751694 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:22.900374 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:22.909982 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:22.911496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:22.912942 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-421fcf1b-f2cf-48f8-866c-d7870bc4cc2f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1721 microversion: 2.20 time: 0.175686 Oct 04 12:16:22.913522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 829/1086] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:22 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:23.941464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:23.942254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:23.949376 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:23.949871 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:23.950307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:23.951036 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:23.951498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:23.952042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:24.122629 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:24.132876 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:24.136805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:24.136805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4fb3f929-a3c1-4641-9f4d-c8c40559a298 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1724 microversion: 2.20 time: 0.198829 Oct 04 12:16:24.136805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 830/1087] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:23 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:24.179001 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d4482c5-d6aa-4cdf-a468-d3a3e38c4bc0"}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:16:24.182769 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:24.193620 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:24.194398 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:24.195160 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:24.196598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:24.197297 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:24.197906 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:25.027485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:25.495918 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-23b7bb4c-1a9f-49f2-80dd-d61e614fedd3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.324196 Oct 04 12:16:25.496894 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 831/1088] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Oct 4 12:16:24 2022] POST /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-volume_attachments => generated 188 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 12:16:25.502867 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-34c4ff78-f6b0-4631-af3d-3cfc616b7a9d req-d989dd18-0872-4020-9ba1-8eb7517e127f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53adef1b-9c39-4311-9718-5a32a60b9bc5", "name": "network-vif-unplugged", "status": "completed", "tag": "ff37dcc9-d53c-4424-bdd4-b2400ee2d656"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:16:25.518521 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-34c4ff78-f6b0-4631-af3d-3cfc616b7a9d req-d989dd18-0872-4020-9ba1-8eb7517e127f service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:25.519174 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-34c4ff78-f6b0-4631-af3d-3cfc616b7a9d req-d989dd18-0872-4020-9ba1-8eb7517e127f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:25.519727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-34c4ff78-f6b0-4631-af3d-3cfc616b7a9d req-d989dd18-0872-4020-9ba1-8eb7517e127f service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:25.534008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.compute.server_external_events [req-34c4ff78-f6b0-4631-af3d-3cfc616b7a9d req-d989dd18-0872-4020-9ba1-8eb7517e127f service nova] Unable to find a host for instance 53adef1b-9c39-4311-9718-5a32a60b9bc5. Dropping event network-vif-unplugged {{(pid=133083) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 12:16:25.535089 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-34c4ff78-f6b0-4631-af3d-3cfc616b7a9d req-d989dd18-0872-4020-9ba1-8eb7517e127f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036990 Oct 04 12:16:25.536000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 832/1089] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 12:16:25.642379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:25.642791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:25.649219 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:25.649736 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:25.650176 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:25.650887 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:25.651342 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:25.651763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:26.380073 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-74f854f2-e476-4733-83bc-eae5eee5245f tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-volume_attachments/4d4482c5-d6aa-4cdf-a468-d3a3e38c4bc0" status: 202 len: 0 microversion: 2.20 time: 0.742307 Oct 04 12:16:26.381008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 833/1090] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Oct 4 12:16:25 2022] DELETE /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-volume_attachments/4d4482c5-d6aa-4cdf-a468-d3a3e38c4bc0 => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:16:26.450395 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:16:26.451000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:26.459054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:26.459546 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:26.459989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:26.460760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:26.461217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:26.461651 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:26.496674 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133083) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 12:16:26.798402 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-90efa4be-47d1-4111-8c37-716997cfe6d0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "POST /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/action" status: 202 len: 0 microversion: 2.20 time: 0.351892 Oct 04 12:16:26.799471 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 834/1091] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Oct 4 12:16:26 2022] POST /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 12:16:26.814109 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:26.815202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:26.825848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:26.826608 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:26.827275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:26.828544 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:26.829400 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:26.830117 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:27.019031 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:27.035733 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:27.038779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:27.041097 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-de1ec5c1-5737-4ab2-9ba5-a6792c0728cb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1672 microversion: 2.20 time: 0.234786 Oct 04 12:16:27.042151 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 835/1092] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:26 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1672 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:28.083147 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:28.084096 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:28.086606 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:28.092947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:28.092947 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:28.093306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:28.093872 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:28.094325 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:28.094969 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:28.265011 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:28.280496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:28.283538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:28.285856 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4791519a-ed7a-407b-b7ad-8e930122e9a0 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1672 microversion: 2.20 time: 0.206588 Oct 04 12:16:28.287087 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 836/1093] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:28 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:29.327978 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:29.329280 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:29.337054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:29.337684 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:29.338224 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:29.339052 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:29.339611 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:29.340233 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:29.488153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:29.497762 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:29.499366 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:29.500637 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-1accb25c-34b0-487a-8ab8-10c1bab8841b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.177660 Oct 04 12:16:29.501307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 837/1094] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:29 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:30.426280 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:16:30.427005 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:16:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:16:30.532767 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:30.533714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:30.540799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:30.541391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:30.541972 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:30.542714 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:30.543177 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:30.544237 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:30.758241 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:30.768622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:30.770207 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:30.771434 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-68955599-f79b-4479-a9f3-8bbe137456f4 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.243695 Oct 04 12:16:30.772018 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 838/1095] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:30 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:31.804221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:31.806660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:31.818004 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:31.819756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:31.821431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:31.823001 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:31.823930 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:31.825311 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:32.022409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:32.032217 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:32.033931 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:32.035356 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e99e9ca7-3b1e-4ecb-8ffe-203c723ac64d tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.239766 Oct 04 12:16:32.036054 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 839/1096] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:31 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:33.066825 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:33.069835 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:33.095739 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:33.096912 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:33.097834 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:33.098873 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:33.099518 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:33.100124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:33.340724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:33.359789 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:33.361926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:33.363424 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5698ca22-1620-4c89-aae1-f5dbb7d51bee tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.302111 Oct 04 12:16:33.364149 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 840/1097] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:33 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:34.394795 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:34.395853 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:34.405347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:34.406202 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:34.406833 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:34.407848 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:34.408530 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:34.409166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:34.640259 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:34.649642 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:34.651112 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:34.652472 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f75b2feb-8e72-4bf6-9463-7631efdb6795 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.264807 Oct 04 12:16:34.653854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 841/1098] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:34 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:35.684597 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:35.686005 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:35.695899 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:35.696905 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:35.697781 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:35.699267 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:35.700991 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:35.701738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:35.952504 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:35.969655 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:35.971293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:35.972855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6a45014f-b17c-4af8-a3ce-2be94952567c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.296522 Oct 04 12:16:35.973537 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 842/1099] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:35 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:37.008193 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:37.008992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:37.016605 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:37.017132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:37.017536 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:37.018269 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:37.018722 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:37.019141 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:37.201738 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:37.215638 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:37.217289 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:37.218688 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-892ce476-cc16-416e-ac10-10b3f74b37cc tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.216879 Oct 04 12:16:37.219725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 843/1100] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:36 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:38.245742 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:38.247461 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:38.255016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:38.255503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:38.255939 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:38.256709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:38.257159 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:38.257613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:38.435186 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:38.439014 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:UPDATE=7 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:16:38.450243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:38.454203 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:38.456055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c7d54f86-7a6c-4e0e-ae05-016ca2eaf37e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.214761 Oct 04 12:16:38.460373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 844/1101] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:38 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:39.492274 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:39.493085 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:39.499765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:39.500275 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:39.500705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:39.501405 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:39.501855 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:39.502526 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:39.651254 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:39.661124 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:39.662576 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:39.663765 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-6783f4ca-86ca-4a5e-9e5a-0269d464c63c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.176561 Oct 04 12:16:39.664373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 845/1102] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:39 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:40.690008 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:40.690805 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:40.698106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:40.698662 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:40.699148 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:40.700281 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:40.700598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:40.700992 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:40.853236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:40.862492 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:40.863877 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:40.865268 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-fc742add-f73e-41eb-8da3-2c8c2c5bad4e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.179607 Oct 04 12:16:40.865903 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 846/1103] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:40 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:41.894768 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:41.895570 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:41.903061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:41.903671 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:41.904153 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:41.905042 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:41.905616 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:41.906191 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:42.342957 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:42.351838 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:42.353528 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:42.354724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-18a4d3be-3801-4432-9938-e70d183ce5e6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.465333 Oct 04 12:16:42.355308 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 847/1104] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:41 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:43.384635 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:43.385418 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:43.392450 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:43.392952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:43.393522 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:43.394306 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:43.394786 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:43.395251 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:43.549208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:43.565293 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:43.568520 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:43.570799 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5e7b75e9-71b0-4e6a-9251-a5f724d73491 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.190143 Oct 04 12:16:43.571880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 848/1105] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:43 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:44.518859 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-cdc2f89e-e7f5-4ee4-bd74-53ed78f88844 req-1f7877b6-399c-4d2d-b313-15123fde2636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53adef1b-9c39-4311-9718-5a32a60b9bc5", "name": "network-vif-plugged", "status": "completed", "tag": "ff37dcc9-d53c-4424-bdd4-b2400ee2d656"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:16:44.530534 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-cdc2f89e-e7f5-4ee4-bd74-53ed78f88844 req-1f7877b6-399c-4d2d-b313-15123fde2636 service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:44.536695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-cdc2f89e-e7f5-4ee4-bd74-53ed78f88844 req-1f7877b6-399c-4d2d-b313-15123fde2636 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:44.536695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-cdc2f89e-e7f5-4ee4-bd74-53ed78f88844 req-1f7877b6-399c-4d2d-b313-15123fde2636 service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:44.544898 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-cdc2f89e-e7f5-4ee4-bd74-53ed78f88844 req-1f7877b6-399c-4d2d-b313-15123fde2636 service nova] Creating event network-vif-plugged:ff37dcc9-d53c-4424-bdd4-b2400ee2d656 for instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 on hv-cinder-86021 Oct 04 12:16:44.550277 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-cdc2f89e-e7f5-4ee4-bd74-53ed78f88844 req-1f7877b6-399c-4d2d-b313-15123fde2636 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035134 Oct 04 12:16:44.550911 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 849/1106] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:16:44.613586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:44.614330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:44.624229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:44.625106 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:44.625938 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:44.627169 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:44.628270 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:44.629040 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:44.809650 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:44.824659 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:44.827741 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:44.831904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-5e157c08-3730-4b46-adbc-e2c8f984d4b5 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.220996 Oct 04 12:16:44.831904 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 850/1107] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:44 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:45.873532 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:45.874630 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:45.881379 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:45.881880 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:45.882307 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:45.883055 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:45.883711 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:45.884677 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:46.048529 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:46.057854 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:46.059373 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:46.060648 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-2269d512-637e-45a6-a0a3-58036e39cf7e tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.192490 Oct 04 12:16:46.061223 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 851/1108] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:45 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:47.087705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:47.088485 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:47.096013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:47.096649 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:47.097132 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:47.097926 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:47.098425 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:47.098954 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:47.298660 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:47.307946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:47.309478 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:47.310676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-418cf437-5824-4756-9b4a-65d3c668d1a3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1730 microversion: 2.20 time: 0.227362 Oct 04 12:16:47.311319 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 852/1109] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:47 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 12:16:48.335257 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:16:48.336000 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:16:48.343470 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:48.344027 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:48.344598 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:48.345680 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:16:48.346221 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:16:48.346661 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:16:48.495168 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:48.505489 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:48.506981 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:16:48.508332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-68fc3166-da3e-48b7-a968-3bbf155f139a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1717 microversion: 2.20 time: 0.176908 Oct 04 12:16:48.508909 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 853/1110] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:16:48 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:16:48.586629 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:16:48.587481 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:17:22.536383 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:22.538573 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:22.541279 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_api:SELECT=35 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:22.542170 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG dbcounter [-] [133083] Writing DB stats nova_cell1:SELECT=51 {{(pid=133083) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 12:17:22.547640 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.548134 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.548599 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.549320 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.549774 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.550200 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.583747 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c757e55e-2fc7-44ec-aa69-57ff576ccf4a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051676 Oct 04 12:17:22.584416 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 854/1111] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Oct 4 12:17:22 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 12:17:22.659188 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:22.659692 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:22.666884 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.667375 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.667813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.668566 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:22.669017 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:22.669436 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:22.696827 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Going to try to terminate instance {{(pid=133083) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 12:17:23.031831 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-c620c6c8-2812-4692-82d7-e0fecf7177f6 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 204 len: 0 microversion: 2.20 time: 0.376661 Oct 04 12:17:23.032498 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 855/1112] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 4 12:17:22 2022] DELETE /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 12:17:23.041806 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:23.042519 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:23.049068 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:23.049560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:23.050016 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:23.050718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:23.051229 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:23.051594 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:23.256503 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:23.265997 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:23.267761 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:23.269076 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-368d0915-8331-4093-8112-1e0d869a05ce tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.231723 Oct 04 12:17:23.269695 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 856/1113] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:17:23 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:17:24.298020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:24.299192 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:24.306284 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:24.306800 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:24.307296 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:24.308013 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:24.308564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:24.309023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:24.464763 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:24.473757 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:24.475334 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:24.476583 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-f39a560b-46b2-4360-a5ac-5b1dcd490d9a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1723 microversion: 2.20 time: 0.183110 Oct 04 12:17:24.477166 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 857/1114] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:17:24 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:17:25.504582 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:25.505705 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:25.512606 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:25.513110 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:25.513549 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:25.514281 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:25.514746 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:25.515173 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:25.587924 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:25.604888 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:25.605897 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:25.607234 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-56d2753a-1fb5-4009-8f25-72e1dcabfd5a tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1655 microversion: 2.20 time: 0.107266 Oct 04 12:17:25.607820 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 858/1115] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:17:25 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:17:26.191622 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [req-3f7a5db9-0a19-4cd7-bbf6-b3cc564d566c req-50a3c58a-cbc4-45bf-b1aa-ba173442eb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53adef1b-9c39-4311-9718-5a32a60b9bc5", "name": "network-vif-deleted", "tag": "ff37dcc9-d53c-4424-bdd4-b2400ee2d656"}]} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:26.203881 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-3f7a5db9-0a19-4cd7-bbf6-b3cc564d566c req-50a3c58a-cbc4-45bf-b1aa-ba173442eb7c service nova] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:26.204496 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-3f7a5db9-0a19-4cd7-bbf6-b3cc564d566c req-50a3c58a-cbc4-45bf-b1aa-ba173442eb7c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:26.204946 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [req-3f7a5db9-0a19-4cd7-bbf6-b3cc564d566c req-50a3c58a-cbc4-45bf-b1aa-ba173442eb7c service nova] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:26.218023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.compute.server_external_events [req-3f7a5db9-0a19-4cd7-bbf6-b3cc564d566c req-50a3c58a-cbc4-45bf-b1aa-ba173442eb7c service nova] Creating event network-vif-deleted:ff37dcc9-d53c-4424-bdd4-b2400ee2d656 for instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 on hv-cinder-86021 Oct 04 12:17:26.224815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [req-3f7a5db9-0a19-4cd7-bbf6-b3cc564d566c req-50a3c58a-cbc4-45bf-b1aa-ba173442eb7c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040832 Oct 04 12:17:26.229347 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 859/1116] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Oct 4 12:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 12:17:26.641236 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:26.642315 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:26.650891 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:26.651465 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:26.652107 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:26.653020 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:26.653586 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:26.654090 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:26.693119 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:26.693612 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:26.694056 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:26.694524 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.objects.instance [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lazy-loading 'fault' on Instance uuid 53adef1b-9c39-4311-9718-5a32a60b9bc5 {{(pid=133083) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 12:17:26.773030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:26.773030 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:26.774023 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.policy [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ab97a61223f4719add7b3c0f845a319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d4317234c458daad66f591d27c6fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133083) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 12:17:26.775335 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-4123c3d9-80c8-40e1-9e51-c906d4efa2c3 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 200 len: 1371 microversion: 2.20 time: 0.139347 Oct 04 12:17:26.776396 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 860/1117] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:17:26 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 12:17:27.805443 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:27.806208 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:27.815053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:27.815718 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:27.816341 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:27.817309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:27.818183 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:27.818748 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:27.838334 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] HTTP exception thrown: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Request method failure captured: Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 HTTP/1.1 Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLLpVCmpeqs4CYzDE9xK22aSZJ8LCYwOhUZ2nfyNremRVPo7anjFShtKK112SFVyJ6pTwua-1m7HwJnxKKcwEcocrGlhgK2KVKoXDVY2lnHaajvy4legJcy1iIe1zenMzQBD15qGLKY4RdRRshax2T4Xwd7Wv-h3r8BiWUSSzDh_rA Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:27.841028 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e41d4317234c458daad66f591d27c6fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}] Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 9ab97a61223f4719add7b3c0f845a319 Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:27.844510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '53adef1b-9c39-4311-9718-5a32a60b9bc5'} Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:27.845803 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:27.847283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:27.849523 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Returning 404 to user: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:27.849523 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-236971f3-6de2-48d7-87d3-b9a3229d0b29 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 404 len: 111 microversion: 2.20 time: 0.045491 Oct 04 12:17:27.849523 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 861/1118] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:17:27 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 12:17:27.856879 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-7cf845ea-7311-4a9d-a74e-059cb1202a9c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '.version_select at 0x7f10c3945ca0>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:27.956033 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-7cf845ea-7311-4a9d-a74e-059cb1202a9c tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298529947" status: 204 len: 0 microversion: 2.20 time: 0.103243 Oct 04 12:17:27.957507 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 862/1119] 10.222.0.15 () {60 vars in 1259 bytes} [Tue Oct 4 12:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298529947 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 12:17:30.330282 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:30.331103 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:30.339230 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:30.339727 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:30.340196 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:30.340933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:30.341387 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:30.341815 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:30.358636 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] HTTP exception thrown: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Request method failure captured: Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 HTTP/1.1 Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLLpVCmpeqs4CYzDE9xK22aSZJ8LCYwOhUZ2nfyNremRVPo7anjFShtKK112SFVyJ6pTwua-1m7HwJnxKKcwEcocrGlhgK2KVKoXDVY2lnHaajvy4legJcy1iIe1zenMzQBD15qGLKY4RdRRshax2T4Xwd7Wv-h3r8BiWUSSzDh_rA Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:30.360332 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e41d4317234c458daad66f591d27c6fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}] Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 9ab97a61223f4719add7b3c0f845a319 Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.363314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '53adef1b-9c39-4311-9718-5a32a60b9bc5'} Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:30.365145 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.367555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.370502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Returning 404 to user: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:30.370502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-08572a72-43db-4d7d-8e0e-f1ac3d44807b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 404 len: 111 microversion: 2.20 time: 0.036331 Oct 04 12:17:30.370502 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 863/1120] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 4 12:17:30 2022] DELETE /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 12:17:30.371409 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:30.372034 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 53adef1b-9c39-4311-9718-5a32a60b9bc5] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:30.378756 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:30.379244 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:30.379681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:30.380667 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:30.381133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:30.381565 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:30.398290 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] HTTP exception thrown: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Request method failure captured: Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 HTTP/1.1 Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLLpVCmpeqs4CYzDE9xK22aSZJ8LCYwOhUZ2nfyNremRVPo7anjFShtKK112SFVyJ6pTwua-1m7HwJnxKKcwEcocrGlhgK2KVKoXDVY2lnHaajvy4legJcy1iIe1zenMzQBD15qGLKY4RdRRshax2T4Xwd7Wv-h3r8BiWUSSzDh_rA Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:30.399890 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e41d4317234c458daad66f591d27c6fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}] Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 9ab97a61223f4719add7b3c0f845a319 Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.402952 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '53adef1b-9c39-4311-9718-5a32a60b9bc5'} Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:30.403813 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. Oct 04 12:17:30.406323 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:30.409133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Returning 404 to user: Instance 53adef1b-9c39-4311-9718-5a32a60b9bc5 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:30.409133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ed4f82da-8399-49b8-a29f-f62b298d0ecb tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5" status: 404 len: 111 microversion: 2.20 time: 0.034664 Oct 04 12:17:30.409133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 864/1121] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:17:30 2022] GET /compute/v2.1/servers/53adef1b-9c39-4311-9718-5a32a60b9bc5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 12:17:31.795672 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:31.796702 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:31.809572 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:31.810422 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:31.811173 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:31.812510 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:31.813357 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:31.814154 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:31.844719 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] HTTP exception thrown: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Request method failure captured: Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc HTTP/1.1 Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLLpVCmpeqs4CYzDE9xK22aSZJ8LCYwOhUZ2nfyNremRVPo7anjFShtKK112SFVyJ6pTwua-1m7HwJnxKKcwEcocrGlhgK2KVKoXDVY2lnHaajvy4legJcy1iIe1zenMzQBD15qGLKY4RdRRshax2T4Xwd7Wv-h3r8BiWUSSzDh_rA Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:31.847893 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e41d4317234c458daad66f591d27c6fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}] Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 9ab97a61223f4719add7b3c0f845a319 Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.850533 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '8eede383-c39e-47b4-8bc0-0aae982633bc'} Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:31.853724 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.857010 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.859921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Returning 404 to user: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:31.859921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-71d211ae-dd79-4287-9404-5ee6bf89d785 tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 404 len: 111 microversion: 2.20 time: 0.062531 Oct 04 12:17:31.859921 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 865/1122] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Oct 4 12:17:31 2022] DELETE /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 12:17:31.867594 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Calling method '>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:31.869691 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.compute.api [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] [instance: 8eede383-c39e-47b4-8bc0-0aae982633bc] Fetching instance by UUID {{(pid=133083) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 12:17:31.880710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:31.881538 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:31.882298 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:31.883500 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Acquiring lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 12:17:31.884381 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 12:17:31.885779 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG oslo_concurrency.lockutils [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Lock "bf8dfa22-144b-412c-a385-0fe77772a1d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133083) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 12:17:31.905989 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] HTTP exception thrown: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Request method failure captured: Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc HTTP/1.1 Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCLLpVCmpeqs4CYzDE9xK22aSZJ8LCYwOhUZ2nfyNremRVPo7anjFShtKK112SFVyJ6pTwua-1m7HwJnxKKcwEcocrGlhgK2KVKoXDVY2lnHaajvy4legJcy1iIe1zenMzQBD15qGLKY4RdRRshax2T4Xwd7Wv-h3r8BiWUSSzDh_rA Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:31.907613 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e41d4317234c458daad66f591d27c6fa", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e41d4317234c458daad66f591d27c6fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e41d4317234c458daad66f591d27c6fa"}]}] Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: e41d4317234c458daad66f591d27c6fa Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-63843409 Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 9ab97a61223f4719add7b3c0f845a319 Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-AttachVolumeShelveTestJSON-63843409-project Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: > Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.912561 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': '8eede383-c39e-47b4-8bc0-0aae982633bc'} Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:31.914322 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. Oct 04 12:17:31.919053 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:31.921666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] Returning 404 to user: Instance 8eede383-c39e-47b4-8bc0-0aae982633bc could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:31.921666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-b71ef33a-2f7e-41ff-9e5f-e8d57abd8a4b tempest-AttachVolumeShelveTestJSON-63843409 tempest-AttachVolumeShelveTestJSON-63843409-project] 10.222.0.15 "GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc" status: 404 len: 111 microversion: 2.20 time: 0.051153 Oct 04 12:17:31.921666 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 866/1123] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Oct 4 12:17:31 2022] GET /compute/v2.1/servers/8eede383-c39e-47b4-8bc0-0aae982633bc => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 12:17:38.583309 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e866b210-6648-4ca4-9a53-4a58b74d11f3 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Action: 'create', calling method: .version_select at 0x7f10c38ff670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-354454950", "metadata": {"Type": "work"}}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e866b210-6648-4ca4-9a53-4a58b74d11f3 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Request method failure captured: Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 121 Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCRi_n-pzvenWT9A4jo0d3c1hnl3U0ENsur9CgeCQjhHjgmqVo0k6OAwqHxSGd23TwDF3vbpJ4Vlt5rWuwreNYF7vuM7GCvtdQMehZ2uj9w_v7IRr-B30uv1BIn6taiwQSxzhGek95rNV33WoLcVAhtg5rBR4eAo6jVQtNub6zOMD84 Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:38.629431 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_26b44051c3ed4ccaac86fd204899886b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}] Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2c6b15d2fb484260876a3401a9e2dc87 Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-354454950", "metadata": {"Type": "work"}}} Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:17:38.632358 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-354454950', 'metadata': {'Type': 'work'}}}} Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise error Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:38.633908 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 12:17:38.637955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 12:17:38.640464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 12:17:38.640464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.640464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-e866b210-6648-4ca4-9a53-4a58b74d11f3 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:38.640464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-e866b210-6648-4ca4-9a53-4a58b74d11f3 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.189641 Oct 04 12:17:38.640464 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 867/1124] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 4 12:17:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 12:17:38.642932 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-efbf1b04-82f2-4787-96ab-71d707dbb5c4 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Action: 'create', calling method: .version_select at 0x7f10c702d160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1310806144", "metadata": {"Type": "work"}}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-efbf1b04-82f2-4787-96ab-71d707dbb5c4 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Request method failure captured: Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 120 Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCRi_n-pzvenWT9A4jo0d3c1hnl3U0ENsur9CgeCQjhHjgmqVo0k6OAwqHxSGd23TwDF3vbpJ4Vlt5rWuwreNYF7vuM7GCvtdQMehZ2uj9w_v7IRr-B30uv1BIn6taiwQSxzhGek95rNV33WoLcVAhtg5rBR4eAo6jVQtNub6zOMD84 Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:38.646626 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_26b44051c3ed4ccaac86fd204899886b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}] Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2c6b15d2fb484260876a3401a9e2dc87 Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1310806144", "metadata": {"Type": "work"}}} Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:17:38.649547 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1310806144', 'metadata': {'Type': 'work'}}}} Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise error Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi '0' Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:38.651061 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 12:17:38.653699 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 12:17:38.655575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 12:17:38.655575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.655575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-efbf1b04-82f2-4787-96ab-71d707dbb5c4 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:38.655575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-efbf1b04-82f2-4787-96ab-71d707dbb5c4 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009341 Oct 04 12:17:38.655575 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 868/1125] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 4 12:17:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 12:17:38.661955 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ccc1a5e9-1636-4c16-8e44-a5c7908dd753 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Action: 'create', calling method: .version_select at 0x7f10c3bb74c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1641357452", "metadata": {"Type": "work"}}} {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ccc1a5e9-1636-4c16-8e44-a5c7908dd753 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Request method failure captured: Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 119 Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCRi_n-pzvenWT9A4jo0d3c1hnl3U0ENsur9CgeCQjhHjgmqVo0k6OAwqHxSGd23TwDF3vbpJ4Vlt5rWuwreNYF7vuM7GCvtdQMehZ2uj9w_v7IRr-B30uv1BIn6taiwQSxzhGek95rNV33WoLcVAhtg5rBR4eAo6jVQtNub6zOMD84 Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:38.665791 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_26b44051c3ed4ccaac86fd204899886b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}] Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2c6b15d2fb484260876a3401a9e2dc87 Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1641357452", "metadata": {"Type": "work"}}} Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:17:38.668133 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1641357452', 'metadata': {'Type': 'work'}}}} Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise error Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi '' Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:38.669155 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 12:17:38.670681 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 12:17:38.671984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 12:17:38.671984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.671984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ccc1a5e9-1636-4c16-8e44-a5c7908dd753 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:38.671984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ccc1a5e9-1636-4c16-8e44-a5c7908dd753 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010709 Oct 04 12:17:38.671984 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 869/1126] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Oct 4 12:17:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 12:17:38.680391 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ae131de2-1da9-41b3-9001-a74b63434b5b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Calling method '.version_select at 0x7f10c6ffcc10>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:38.845474 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-ae131de2-1da9-41b3-9001-a74b63434b5b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] HTTP exception thrown: Volume tempest-invalid-416003904 could not be found. Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ae131de2-1da9-41b3-9001-a74b63434b5b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Request method failure captured: Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-416003904 HTTP/1.1 Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCRi_n-pzvenWT9A4jo0d3c1hnl3U0ENsur9CgeCQjhHjgmqVo0k6OAwqHxSGd23TwDF3vbpJ4Vlt5rWuwreNYF7vuM7GCvtdQMehZ2uj9w_v7IRr-B30uv1BIn6taiwQSxzhGek95rNV33WoLcVAhtg5rBR4eAo6jVQtNub6zOMD84 Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:38.848146 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_26b44051c3ed4ccaac86fd204899886b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}] Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2c6b15d2fb484260876a3401a9e2dc87 Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Volume tempest-invalid-416003904 could not be found. Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'tempest-invalid-416003904'} Oct 04 12:17:38.851360 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-416003904 could not be found. (HTTP 404) (Request-ID: req-083b0c97-a429-4d93-99d4-4ba36112a31a) Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.853709 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 12:17:38.856935 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-416003904 could not be found. Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:38.860697 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-416003904 could not be found. Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-416003904 could not be found. Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-ae131de2-1da9-41b3-9001-a74b63434b5b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Returning 404 to user: Volume tempest-invalid-416003904 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-ae131de2-1da9-41b3-9001-a74b63434b5b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-416003904" status: 404 len: 98 microversion: 2.1 time: 0.173756 Oct 04 12:17:38.863501 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 870/1127] 10.222.0.15 () {58 vars in 1215 bytes} [Tue Oct 4 12:17:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-416003904 => generated 98 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 12:17:38.871560 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-53adc905-b959-4b05-b2a7-0f18bd858b5b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010412 Oct 04 12:17:38.872283 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 871/1128] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Oct 4 12:17:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 04 12:17:38.882678 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-935c7143-181d-4225-856a-69e686b778c2 tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004245 Oct 04 12:17:38.883243 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 872/1129] 10.222.0.15 () {58 vars in 1137 bytes} [Tue Oct 4 12:17:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 12:17:38.896753 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-54a3058c-55a8-45bb-8d50-d9eabbfec68b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Calling method '.version_select at 0x7f10c3bb7940>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:38.935760 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-54a3058c-55a8-45bb-8d50-d9eabbfec68b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] HTTP exception thrown: Volume c9888589-04bc-4389-8d10-3125c8ae390e could not be found. Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-54a3058c-55a8-45bb-8d50-d9eabbfec68b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Request method failure captured: Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: DELETE /compute/v2.1/os-volumes/c9888589-04bc-4389-8d10-3125c8ae390e HTTP/1.1 Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCRi_n-pzvenWT9A4jo0d3c1hnl3U0ENsur9CgeCQjhHjgmqVo0k6OAwqHxSGd23TwDF3vbpJ4Vlt5rWuwreNYF7vuM7GCvtdQMehZ2uj9w_v7IRr-B30uv1BIn6taiwQSxzhGek95rNV33WoLcVAhtg5rBR4eAo6jVQtNub6zOMD84 Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:38.939682 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_26b44051c3ed4ccaac86fd204899886b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}] Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2c6b15d2fb484260876a3401a9e2dc87 Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Volume c9888589-04bc-4389-8d10-3125c8ae390e could not be found. Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'c9888589-04bc-4389-8d10-3125c8ae390e'} Oct 04 12:17:38.941725 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9888589-04bc-4389-8d10-3125c8ae390e could not be found. (HTTP 404) (Request-ID: req-19eb4d38-2ab6-4ca2-bfdf-22f32ed93111) Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.943075 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 12:17:38.944710 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9888589-04bc-4389-8d10-3125c8ae390e could not be found. Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 12:17:38.946330 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9888589-04bc-4389-8d10-3125c8ae390e could not be found. Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9888589-04bc-4389-8d10-3125c8ae390e could not be found. Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-54a3058c-55a8-45bb-8d50-d9eabbfec68b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Returning 404 to user: Volume c9888589-04bc-4389-8d10-3125c8ae390e could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-54a3058c-55a8-45bb-8d50-d9eabbfec68b tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/c9888589-04bc-4389-8d10-3125c8ae390e" status: 404 len: 109 microversion: 2.1 time: 0.050743 Oct 04 12:17:38.947933 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 873/1130] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Oct 4 12:17:38 2022] DELETE /compute/v2.1/os-volumes/c9888589-04bc-4389-8d10-3125c8ae390e => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 12:17:38.959836 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-89d72544-23e4-49ed-b8ac-22dae22a020d tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Calling method '.version_select at 0x7f10c38ff700>' {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 12:17:39.000564 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.wsgi [None req-89d72544-23e4-49ed-b8ac-22dae22a020d tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] HTTP exception thrown: Volume a668f721-be2d-45b6-8995-773fa6688573 could not be found. Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-89d72544-23e4-49ed-b8ac-22dae22a020d tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Request method failure captured: Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: request: GET /compute/v2.1/os-volumes/a668f721-be2d-45b6-8995-773fa6688573 HTTP/1.1 Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept: application/json Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Accept-Encoding: identity Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Connection: close Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Length: 0 Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Content-Type: application/json Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Host: 10.222.0.15 Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: Openstack-System-Scope: None Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: User-Agent: python-urllib3/1.26.12 Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Auth-Token: gAAAAABjPCRi_n-pzvenWT9A4jo0d3c1hnl3U0ENsur9CgeCQjhHjgmqVo0k6OAwqHxSGd23TwDF3vbpJ4Vlt5rWuwreNYF7vuM7GCvtdQMehZ2uj9w_v7IRr-B30uv1BIn6taiwQSxzhGek95rNV33WoLcVAhtg5rBR4eAo6jVQtNub6zOMD84 Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Id: None Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Domain-Name: None Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Identity-Status: Confirmed Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Is-Admin-Project: True Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Id: default Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Domain-Name: Default Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Project-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Role: reader,member Oct 04 12:17:39.005314 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Roles: reader,member Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:8080/v1/AUTH_26b44051c3ed4ccaac86fd204899886b", "adminURL": "http://10.222.0.15:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/26b44051c3ed4ccaac86fd204899886b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/26b44051c3ed4ccaac86fd204899886b"}]}] Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Id: 26b44051c3ed4ccaac86fd204899886b Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-Tenant-Name: tempest-VolumesNegativeTest-1431033217 Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Id: default Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Domain-Name: Default Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Id: 2c6b15d2fb484260876a3401a9e2dc87 Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: X-User-Name: tempest-VolumesNegativeTest-1431033217-project Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: method: Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: exception: Volume a668f721-be2d-45b6-8995-773fa6688573 could not be found. Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: action_args: {'id': 'a668f721-be2d-45b6-8995-773fa6688573'} Oct 04 12:17:39.007676 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: {{(pid=133083) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a668f721-be2d-45b6-8995-773fa6688573 could not be found. (HTTP 404) (Request-ID: req-332c7a7e-5f2c-44d1-87e5-6c4625596cf1) Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:39.008673 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 12:17:39.012263 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a668f721-be2d-45b6-8995-773fa6688573 could not be found. Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 12:17:39.014555 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a668f721-be2d-45b6-8995-773fa6688573 could not be found. Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a668f721-be2d-45b6-8995-773fa6688573 could not be found. Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: ERROR nova.api.openstack.wsgi Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: DEBUG nova.api.openstack.wsgi [None req-89d72544-23e4-49ed-b8ac-22dae22a020d tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] Returning 404 to user: Volume a668f721-be2d-45b6-8995-773fa6688573 could not be found. {{(pid=133083) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: INFO nova.api.openstack.requestlog [None req-89d72544-23e4-49ed-b8ac-22dae22a020d tempest-VolumesNegativeTest-1431033217 tempest-VolumesNegativeTest-1431033217-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/a668f721-be2d-45b6-8995-773fa6688573" status: 404 len: 109 microversion: 2.1 time: 0.055185 Oct 04 12:17:39.015852 dv-cinder-860212-2-iscsi devstack@n-api.service[133083]: [pid: 133083|app: 0|req: 874/1131] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Oct 4 12:17:38 2022] GET /compute/v2.1/os-volumes/a668f721-be2d-45b6-8995-773fa6688573 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 12:19:32.872607 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:19:32.873284 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:19:50.438187 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:19:50.439071 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:19:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:20:08.599341 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:20:08.600094 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:22:52.884386 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 12:22:52.885217 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:22:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:23:02.220551 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG neutronclient.v2_0.client [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=133084) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 12:23:02.221406 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack.requestlog [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.724411 Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack Traceback (most recent call last): Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-45de4618-af6b-4f9a-b609-3d5196af92e0'] Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack Traceback (most recent call last): Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return req.get_response(self.application) Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 12:23:02.299812 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack self.force_reraise() Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack raise self.value Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 12:23:02.302070 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return request.get_response(self.application) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 04 12:23:02.303593 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return resp(environ, start_response) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 04 12:23:02.305719 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self._create_instance( Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Oct 04 12:23:02.307715 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2626, in validate_networks Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ports_needed_per_instance = self._ports_needed_per_instance( Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2548, in _ports_needed_per_instance Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack nets = self._get_available_networks( Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 454, in _get_available_networks Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack nets = neutron.list_networks(**search_opts).get('networks', []) Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 860, in list_networks Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.list('networks', self.networks_path, retrieve_all, Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 12:23:02.310827 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova.api.openstack Oct 04 12:23:02.313117 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: INFO nova.api.openstack [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] http://10.222.0.15/compute/v2.1/servers returned with HTTP 401 Oct 04 12:23:02.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: DEBUG nova.api.openstack.wsgi [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=133084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 12:23:02.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Oct 04 12:23:02.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: Tue Oct 4 12:23:02 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.15) Oct 04 12:23:02.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: CRITICAL nova [None req-a0a2cbcc-9055-4fac-a288-30412cab82f7 tempest-TestShelveInstance-1883906822 tempest-TestShelveInstance-1883906822-project] Unhandled error: OSError: write error Oct 04 12:23:02.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova OSError: write error Oct 04 12:23:02.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: ERROR nova Oct 04 12:23:02.314851 dv-cinder-860212-2-iscsi devstack@n-api.service[133084]: [pid: 133084|app: 0|req: 258/1132] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Oct 4 12:08:01 2022] POST /compute/v2.1/servers => generated 0 bytes in 900807 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0)